-- Logs begin at Thu 2022-09-15 00:04:23 UTC, end at Thu 2022-09-15 01:07:20 UTC. -- Sep 15 00:35:53.279596 dv-cinder-857528-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 00:35:53.289033 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 00:35:53 2022] *** Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: nodename: dv-cinder-857528-2-iscsi Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: machine: x86_64 Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: clock source: unix Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: pcre jit disabled Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: detected number of CPU cores: 4 Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: current working directory: / Sep 15 00:35:53.290987 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: detected binary path: /usr/bin/uwsgi-core Sep 15 00:35:53.291730 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: your processes number limit is 47680 Sep 15 00:35:53.291730 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: your memory page size is 4096 bytes Sep 15 00:35:53.291730 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: detected max file descriptor number: 2048 Sep 15 00:35:53.291730 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: lock engine: pthread robust mutexes Sep 15 00:35:53.291730 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: thunder lock: enabled Sep 15 00:35:53.291730 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 00:35:53.291730 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 00:35:53.329986 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: Python main interpreter initialized at 0x55d655ae59c0 Sep 15 00:35:53.329986 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: python threads support enabled Sep 15 00:35:53.329986 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: your server socket listen backlog is limited to 100 connections Sep 15 00:35:53.329986 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: your mercy for graceful operations on workers is 90 seconds Sep 15 00:35:53.330300 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 00:35:53.330383 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: *** Operational MODE: preforking *** Sep 15 00:35:53.330633 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: *** uWSGI is running in multiple interpreter mode *** Sep 15 00:35:53.330633 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: spawned uWSGI master process (pid: 112169) Sep 15 00:35:53.330816 dv-cinder-857528-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 00:35:53.331362 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: spawned uWSGI worker 1 (pid: 112170, cores: 1) Sep 15 00:35:53.331715 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: spawned uWSGI worker 2 (pid: 112171, cores: 1) Sep 15 00:35:53.331880 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 00:35:53.990977 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 00:35:53.996161 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 00:35:55.078063 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:35:55.078063 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: from cryptography.utils import int_from_bytes Sep 15 00:35:55.078640 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:35:55.078640 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: from cryptography.utils import int_from_bytes Sep 15 00:35:55.081655 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:35:55.081655 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: from cryptography.utils import int_from_bytes Sep 15 00:35:55.082093 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:35:55.082093 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: from cryptography.utils import int_from_bytes Sep 15 00:35:57.560327 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 00:35:57.560955 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 00:35:57.561328 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 00:35:57.561439 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 00:35:57.561541 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 00:35:57.561624 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 00:35:57.561711 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 00:35:57.561793 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 00:35:57.561872 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 00:35:57.561964 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 00:35:57.562046 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.562131 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.562364 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.562462 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.562682 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.562779 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.563000 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.563097 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.563329 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.563448 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.563666 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.563801 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.563986 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.564080 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.564303 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.564413 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.564625 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.564721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.564884 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.564981 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.565199 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.565296 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.565521 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857528-2-iscsi {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.565616 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857528-2-iscsi {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.565838 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.565926 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.566144 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.566244 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.566449 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.566546 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.566765 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.566863 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.567065 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.567208 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.567384 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.567500 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.567716 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.567816 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.568209 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.568315 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.568646 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.568795 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.568952 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.569079 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.569258 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.569551 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.569681 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.569765 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.569890 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.569992 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.570196 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.570288 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.570512 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.570597 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.570816 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.570909 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.571135 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.571221 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.571437 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.571561 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.571859 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857528-2-iscsi {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.571946 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857528-2-iscsi {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.572177 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.572311 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.572489 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.572581 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.572799 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.572894 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.573206 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.573312 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.573513 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.573603 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.573818 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.573906 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.574135 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.574221 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.574454 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.574539 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.574760 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.574853 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.575614 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.575711 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.575938 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.576043 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.576256 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.576343 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.576577 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.576662 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.576877 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.576975 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.577182 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.577321 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.577487 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.577616 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.577804 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.577903 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.578106 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.578208 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.578408 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.578494 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.578655 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.578748 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.578960 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.579054 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.579278 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.579372 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.579618 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.579708 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.579940 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.580029 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.580191 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.580294 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.580439 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.580533 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.580755 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.580851 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.581073 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.581173 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.581378 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.581475 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.581681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.581767 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.581983 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.582080 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.582287 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.582374 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.582589 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.582685 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.582891 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.582978 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.583192 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.583279 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.583515 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.583640 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.583834 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.583978 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.584147 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.584234 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.584464 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.584552 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.584768 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.584854 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.585082 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.585181 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.585476 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.585563 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.585727 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.585814 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.586029 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.586129 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.586366 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.586465 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.586680 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.586771 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.586983 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.587070 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.587297 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.587436 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.587640 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.587729 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.587946 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.588031 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.588248 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.588347 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.588551 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.588638 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.588864 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.588950 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.589194 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.589293 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.589493 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.589579 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.589740 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.589835 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.590037 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.590124 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.590336 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.590433 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.590699 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.591315 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.591535 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.591628 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.591844 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.591932 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.592151 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.592247 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.592451 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.592553 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.592757 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.592845 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.593059 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.593145 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.593361 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.593450 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.593663 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.593757 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.593964 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.594057 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.594265 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.594353 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.594565 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.594699 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.594866 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.594966 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.595167 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.595254 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.595467 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.595626 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.595809 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.595906 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.596125 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.596214 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.596426 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.596520 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.596727 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.596866 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.597027 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.597123 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.597327 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.597414 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.597641 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.597777 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.597942 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.598030 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.598243 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.598329 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.598560 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.598654 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.598862 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.598949 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.599166 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.599254 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.599533 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.599638 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.599805 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.599892 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.600107 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.600193 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.600419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.600520 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.600717 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.600805 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.601017 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.601104 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.601330 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.601418 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.601631 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.601717 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.601930 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.602016 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.602230 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.602317 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.602530 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.602615 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.602829 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.602915 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.603131 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.603217 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.603428 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.603533 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.603753 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.603849 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.604050 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.604181 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.604364 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.604450 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.604676 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.604762 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.604979 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.605073 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.605283 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.605378 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.605582 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.605684 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.605895 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.605981 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:35:57.606244 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.606334 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.606580 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.606676 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.606918 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.607011 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.607232 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.607318 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.607582 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.607686 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.607911 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.607998 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.608227 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.608315 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.608538 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.608626 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.608849 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.608935 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.609172 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.609259 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.609483 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.609581 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.609791 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.609877 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.610100 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.610197 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.610412 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.610519 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.610726 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.610814 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.611050 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.611138 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.611363 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.611458 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.611701 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.611792 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.612017 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.612105 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.612326 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.612415 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.612640 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.612730 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.612964 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.613051 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.613282 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.613370 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.613588 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.613684 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.613929 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.614094 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.614273 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.614368 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.614582 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.614669 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.614903 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.614999 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.615221 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.615319 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.615558 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.615651 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.615871 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.615970 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.616180 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.616266 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.616522 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.616609 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.616832 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.616932 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.617140 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.617229 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.617456 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.617543 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.617763 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.617851 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.618081 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.618167 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.618388 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.618483 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.618698 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.618786 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.619005 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.619099 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.619313 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.619407 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.619645 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.619734 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.619980 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.620069 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.620292 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.620378 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.620610 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.620698 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.620925 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.621020 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.621235 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.621322 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.621547 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.621635 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.621883 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.622186 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.622274 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.622500 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.622593 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.622804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.622893 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.623107 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.623194 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.623410 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.623547 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.623744 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.623833 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.624049 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.624137 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.624353 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.624447 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.624672 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.624760 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.624975 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.625063 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.625294 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.625383 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.625597 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.625684 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.625914 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.626014 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.626224 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.626314 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.626534 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.626622 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.626836 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.626941 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.627140 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.627227 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.627447 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.627553 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.627775 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.627877 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.628080 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.628167 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.628396 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.628484 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.628701 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.628798 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.629004 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.629126 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.629322 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.629457 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.629609 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.629748 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.629929 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.630337 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.630506 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.630648 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.630804 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.630938 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.631116 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.631261 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.631404 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.631590 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.631741 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.631893 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.632071 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.632221 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.632358 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.632500 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.632683 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.632838 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.633019 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.633163 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.633305 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.633453 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.633633 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.633788 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.633957 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.634101 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.634273 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.634432 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.634574 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.634723 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.634861 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.635004 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.635171 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.635334 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.635473 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.635740 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.635884 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.636019 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.636172 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.636321 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.636463 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.636598 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.636805 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.636949 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.637106 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.637297 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.637433 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.638054 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.638176 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.638387 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.638535 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.638676 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.638808 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.638951 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.639080 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.639217 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.639359 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.639505 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.639650 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.639784 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.639922 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.640058 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.640205 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.640296 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.640539 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.640626 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.640874 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.640972 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.641192 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.641280 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.641515 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.641603 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.641828 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.641926 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.642145 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.642241 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.642458 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.642545 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.642784 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.642925 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.643077 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.643200 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.643386 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.643539 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.643722 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.643930 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.644049 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.644169 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.644338 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.644454 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.644649 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.644773 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.644959 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.645073 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.645268 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.645382 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.645581 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.645695 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.645882 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.645996 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.646192 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.646313 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.646510 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.646627 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.646852 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.648262 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.648376 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.648482 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.648609 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.648727 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.648818 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.648913 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.648996 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.649077 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.649166 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.649249 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.649329 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.649416 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.649498 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.649905 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650019 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650096 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650165 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650246 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650326 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650416 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650497 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650575 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650711 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650795 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650874 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.650961 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.651082 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.651169 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.651368 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.651455 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.651695 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.651795 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.652009 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.652096 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.652339 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.652424 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.652708 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.652790 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.652969 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.653070 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.653845 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.653995 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.654305 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.654406 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.654488 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.654579 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.654769 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.654865 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.655256 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.655349 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.655429 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.655723 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.655811 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.656035 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.656231 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.656348 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.656552 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.656668 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.656875 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.656970 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.657193 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.657286 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.657510 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.657603 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.657820 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.657915 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.658142 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.658236 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.658503 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.658681 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.658808 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.659051 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.659263 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.659374 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.659718 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.659877 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.660042 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.660366 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.660452 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.660674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.660967 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.661054 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.661289 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.661579 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.661665 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.661744 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.661894 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.661981 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.662200 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.662287 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.662507 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.662593 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.662836 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.662920 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.663149 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.663236 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.663453 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.663603 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.663786 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.663871 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.664094 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.664182 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.664405 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.664497 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.664723 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.664809 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.665034 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.665120 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.665342 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.665427 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.665663 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.665762 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.665973 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.666059 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.666281 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.666367 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.666592 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.666686 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.666900 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.666984 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.667210 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.667296 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.667543 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.667646 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.667856 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.667941 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.668167 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.668252 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.668476 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.668570 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.668819 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.668906 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.669132 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.669253 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.669456 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.669572 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.669769 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.669900 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.670083 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.670395 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.670478 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.670700 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.670808 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.671011 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.671128 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.671331 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.671452 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.671831 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.671919 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.672154 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.672233 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.672488 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.672564 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.672818 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.672894 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.673132 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.673207 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.673529 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.673600 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.673741 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.673818 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.674048 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.674123 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.674355 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.674430 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.674667 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.674745 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.675125 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.675230 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.675414 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.675576 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.675751 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.675839 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.676062 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.676148 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.676369 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.676473 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.676675 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.676761 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.676979 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.677064 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.677288 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.677382 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.677593 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.677897 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.678202 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.678508 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.678592 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.678825 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.678971 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.679128 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.679438 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.679769 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.680008 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.680108 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.680346 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.680433 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.680679 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.680984 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.681287 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.681465 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.681627 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.681804 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.681934 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.682270 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.682599 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.682900 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.682986 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.683230 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.683314 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.683555 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.683661 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.683878 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.683965 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.684183 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.684269 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.684514 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.684612 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.684819 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.684941 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.685125 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.685297 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.685432 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.685618 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.685732 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.685936 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.686023 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.686273 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.686368 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.686588 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.686675 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.686903 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.686989 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.687217 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.687317 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.687543 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.687631 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.687847 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.687946 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.688161 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.688256 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.688469 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.688555 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.688771 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.688901 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.689074 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.689162 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.689383 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.689476 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.689690 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.689775 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.689989 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.690075 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.690297 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.690384 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.690599 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.690684 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.690912 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.690999 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.691216 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.691302 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.691537 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.691637 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.691841 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.691938 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.692148 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.692242 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.692454 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.692551 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.692752 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.692837 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.693068 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.693153 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.693375 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.693468 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.693678 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.693770 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.693979 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.694066 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.694286 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.694383 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.694586 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.694670 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.694888 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.694976 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.695197 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.695296 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.695537 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.695627 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.695853 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.695992 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.696159 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.696244 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.696463 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.696548 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.696764 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.696850 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.697067 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.697154 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.697368 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.697454 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.697676 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.697770 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.697977 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.698064 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.698279 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.698371 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.698580 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.698673 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.698881 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.698968 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.699183 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.699275 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.699500 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.699665 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.699820 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.699913 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.700650 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.700737 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.700958 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.701052 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.701261 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.701347 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.701604 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.701688 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.701908 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.702005 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.702213 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.702297 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.702537 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.702623 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.702850 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.702944 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.703160 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.703245 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.703468 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.703620 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.703976 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.704086 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.704168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.704246 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.704404 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.704491 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.704721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.704808 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.705031 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.705117 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.705344 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.705448 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.705649 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.705737 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.705952 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.706039 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.706273 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.706369 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.706583 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.706671 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.706889 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.706973 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.707206 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.707299 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.707538 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.707627 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.707859 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.707945 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.708160 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.708258 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.708465 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.708557 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.708771 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.708855 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.709079 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.709173 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.709387 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.709473 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.709697 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.709786 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.710007 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.710103 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.710318 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.710410 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.710625 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.710710 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.710932 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.711025 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.711241 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.711328 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.711571 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.711661 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.711884 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.711977 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.712187 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.712272 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.712491 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.712576 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.712803 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.712891 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.713110 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.713195 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.713413 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.713498 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.713723 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.713809 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.714020 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.714105 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.714327 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.714413 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.714627 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.714714 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.714929 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.715063 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.715255 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.715374 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.715682 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.716331 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.716517 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.716644 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.716831 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.716962 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.717139 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.717273 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.717452 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.717590 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.717759 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.717907 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.718193 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.718279 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.718507 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.718617 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.718819 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.718913 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.719128 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.719215 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.719440 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.719563 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.719776 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.719873 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.720095 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.720181 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.720411 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.720507 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.720718 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.720811 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.721021 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.721138 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.721325 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.721454 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.721629 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.721768 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.721952 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.722079 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.722256 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.722387 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.722577 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.722694 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.722990 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.723079 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.723303 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.723398 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.723630 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.723753 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.723940 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.724028 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.724245 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.724339 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.724570 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.724655 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.724877 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.724971 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.725200 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.725293 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.725562 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.725646 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.725869 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.725975 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.726185 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.726271 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.726495 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.726611 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.726822 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.726908 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.727144 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.727229 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.727454 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.727572 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.727805 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.727892 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.728110 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.728196 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.728432 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.728527 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.728754 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.728847 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.729068 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.729155 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.729390 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.729478 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.729714 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.729801 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.730028 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.730188 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.730343 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.730430 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.730649 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.730736 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.730973 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.731067 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.731343 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.731439 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.731676 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.731764 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.731988 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.732086 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.732291 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.732451 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.732597 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.732779 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.732923 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.733091 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.733228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.733415 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.733538 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.733747 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.733834 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.734055 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.734142 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.734362 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.734449 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.734676 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.734762 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.734982 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.735070 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.735290 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.735376 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.735644 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.735751 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.735953 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.736040 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.736264 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.736358 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.736575 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.736671 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.736883 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.736968 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.737185 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.737270 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.737489 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.737583 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.737791 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.737876 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.738095 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.738188 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.738401 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.738495 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.738718 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.738818 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.739032 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.739118 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.739351 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.739437 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.739684 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.739783 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.740009 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.740096 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.740318 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.740405 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.740621 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.740707 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.740925 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.741011 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.741230 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.741318 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.741565 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.741657 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.741870 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.741967 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.742190 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.742277 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.742492 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.742577 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.742794 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.742888 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.743103 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.743191 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.743404 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.743515 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.743739 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.743838 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.744043 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.744129 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.744352 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.744439 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.744655 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.744750 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.744957 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.745043 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.745260 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.745348 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.745578 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.745673 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.745882 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.745969 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.746201 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.746288 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.746506 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.746591 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.746811 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.746934 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.747140 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.747227 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.747443 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.747559 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.747776 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.747864 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.748082 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.748169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.748409 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.748496 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.748712 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.748797 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.749030 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.749125 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.749346 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.749476 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.749653 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.749789 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.749960 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.750055 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.750266 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.750352 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.750577 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.750663 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.750891 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.750985 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.751207 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.751307 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.751536 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.751625 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.751850 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.751948 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.752163 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.752250 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.752478 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.752570 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.752797 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.752995 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.753126 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.753323 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.753410 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.753638 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.753737 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.753951 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.754037 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.754263 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.754351 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.754577 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.754671 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.754889 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.754981 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.755466 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.755567 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.755803 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.756045 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.756133 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.756375 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.756462 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.756694 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.756793 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.757011 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.757103 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.757327 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.757415 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.757645 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.757738 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.757959 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.758046 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.758274 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.758360 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.758587 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.758685 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.758897 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.758982 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.759210 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.759296 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.759562 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.759668 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.759868 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.759955 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.760185 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.760271 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.760500 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.760594 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.760815 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.760908 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.761125 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.761220 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.761437 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.761526 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.761750 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.761835 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.762061 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.762155 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.762372 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.762458 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.763194 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.763289 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.763533 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.763650 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.763851 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.763947 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.764175 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.764269 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.764490 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.764582 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.764803 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.764895 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.765113 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.765212 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.765426 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.765515 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.765738 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.765828 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.766051 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.766253 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.766353 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.766569 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.766660 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.766903 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.767001 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.767232 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.767324 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.767576 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.767668 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.767894 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.767984 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.768212 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.768303 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.768538 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.768629 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.768845 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.769068 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.769167 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.769385 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.769476 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.769719 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.769812 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.770033 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.770122 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.770356 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.770453 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.770668 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.770767 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.770971 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.771060 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.771290 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.771377 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.771620 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.771720 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.771929 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.772146 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.772232 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.772494 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.772580 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.772812 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.772906 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.773135 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.773222 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.773446 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.773530 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.773759 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.773845 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.774061 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.774146 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.774378 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.774464 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.774682 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.774909 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.774997 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.775259 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.775347 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.775603 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.775707 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.775908 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.775995 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.776212 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.776307 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.776522 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.776616 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.776830 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.776925 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.777137 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.777223 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.777446 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.777533 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.777747 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.777833 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.778063 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.778201 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.778932 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.779113 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.779246 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.779430 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.779583 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.779765 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.779900 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.780081 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.780213 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.780390 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.780520 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.780697 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.780833 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.781004 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.781141 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.781309 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.781470 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.781624 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.781779 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.781932 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.782089 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.782244 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.782396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.782550 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.782709 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.782860 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.783018 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.783210 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.783325 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.783543 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.783647 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.783853 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.783940 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.784177 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.784270 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.784484 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.784571 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.784789 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.784875 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.785106 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.785238 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.785417 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.785503 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.785738 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.785825 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.786049 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.786145 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.786359 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.786445 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.786682 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.786768 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.786991 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.787086 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.787297 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.787550 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.787650 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.787883 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.787970 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.788203 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.788290 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.788536 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.788622 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.788864 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.788957 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.789169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.789254 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.789477 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.789562 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.789782 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.790036 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.790126 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.790374 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.790467 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.790699 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.790793 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.791008 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.791094 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.791321 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.791413 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.791656 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.791746 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.791969 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.792057 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.792275 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.792366 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.792582 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.792676 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.792890 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.792984 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.793200 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.793287 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.793509 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.793608 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.793843 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.793934 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.794150 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.794235 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.794458 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.794554 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.794768 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.794927 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.795082 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.795170 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.795393 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.795512 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.795729 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.795824 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.796041 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.796134 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.796354 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.796440 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.796662 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.796747 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.796970 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.797054 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.797283 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.797369 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.797588 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.797672 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.797900 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.797995 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.798230 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.798318 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.798542 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.798635 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.798845 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.798944 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.799155 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.799466 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.799583 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.799799 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.799885 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.800111 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.800202 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.800426 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.800548 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.800758 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.800855 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.801073 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.801159 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.801383 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.801476 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.801699 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.802024 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.802110 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.802339 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.802425 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.802668 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.802760 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.802991 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.803083 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.803313 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.803398 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.803659 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.803768 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.803969 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.804056 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.804276 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.804363 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.804583 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.804679 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.804893 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.804979 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.805211 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.805297 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.805522 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.805659 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.805828 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.805915 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.806133 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.806226 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.806442 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.806536 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.806745 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.806831 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.807051 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.807137 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.807361 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.807446 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.807691 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.807780 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.808003 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.808097 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.808306 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.808401 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.808611 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.808697 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.808914 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.809000 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.809218 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.809304 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.809544 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.809629 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.809849 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.809942 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.810155 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.810242 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.810499 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.810590 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.810759 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.810857 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.811059 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.811144 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.811361 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.811446 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.811685 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.811783 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.811999 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.812091 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.812305 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.812399 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.812618 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.812713 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.812925 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.813026 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.813235 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.813321 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.813538 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.813636 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.813842 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.813935 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.814148 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.814235 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.814466 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.814558 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.814783 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.814868 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.815092 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.815178 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.815418 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.815521 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.815754 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.815838 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.816065 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.816152 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.816376 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.816469 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.816685 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.816770 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.816995 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.817090 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.817308 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.817401 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.817617 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.817701 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.817941 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.818035 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.818244 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.818331 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.818554 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.818638 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.818866 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.818964 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.819175 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.819260 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.819516 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.819606 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.819815 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.819912 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.820142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.820228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.820448 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.820573 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.820756 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.820843 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.821065 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.821158 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.821374 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.821462 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.821683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.821770 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.821994 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.822086 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.822300 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.822393 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.822610 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.822697 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.822923 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.823010 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.823239 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.823334 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.823571 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.823661 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.823885 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.823971 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.824194 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.824297 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.824510 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.824597 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.824821 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.824914 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.825653 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.825754 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.825974 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.826060 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.826292 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.826378 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.826629 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.826716 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.826942 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.827033 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.827254 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.827340 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.827584 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.827673 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.827837 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 00:35:57.827923 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.828250 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.828566 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.828910 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.829239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.829556 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.829870 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.830176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:35:57.830420 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 00:35:57.983106 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO dbcounter [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Registered counter for database nova_api Sep 15 00:35:57.983396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO dbcounter [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Registered counter for database nova_api Sep 15 00:35:58.003852 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_db.sqlalchemy.engines [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:35:58.005539 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_db.sqlalchemy.engines [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:35:58.010675 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writer thread running {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:35:58.011981 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writer thread running {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:35:58.067861 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.context [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aaf2701d-e0f5-4078-a270-45cab29cee46(cell1) {{(pid=112170) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 00:35:58.071693 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:35:58.072020 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.context [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aaf2701d-e0f5-4078-a270-45cab29cee46(cell1) {{(pid=112171) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 00:35:58.072166 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:35:58.073704 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:35:58.074432 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:35:58.074875 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:35:58.076501 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:35:58.076970 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:35:58.077411 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:35:58.078504 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:35:58.079237 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:35:58.079391 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO dbcounter [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Registered counter for database nova_cell0 Sep 15 00:35:58.079718 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:35:58.081780 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:35:58.083357 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO dbcounter [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Registered counter for database nova_cell1 Sep 15 00:35:58.083783 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO dbcounter [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Registered counter for database nova_cell0 Sep 15 00:35:58.087855 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO dbcounter [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Registered counter for database nova_cell1 Sep 15 00:35:58.090834 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_db.sqlalchemy.engines [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:35:58.092529 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_db.sqlalchemy.engines [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:35:58.094608 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_db.sqlalchemy.engines [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:35:58.096348 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_db.sqlalchemy.engines [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:35:58.098513 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writer thread running {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:35:58.100764 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writer thread running {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:35:58.102177 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writer thread running {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:35:58.104215 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writer thread running {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:35:58.246351 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO dbcounter [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Registered counter for database nova_cell0 Sep 15 00:35:58.247403 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO dbcounter [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Registered counter for database nova_cell0 Sep 15 00:35:58.255908 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG oslo_db.sqlalchemy.engines [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:35:58.260861 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writer thread running {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:35:58.264246 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_db.sqlalchemy.engines [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:35:58.268740 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writer thread running {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:35:58.606986 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: WARNING keystonemiddleware.auth_token [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 00:35:58.613674 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: WARNING keystonemiddleware.auth_token [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 00:35:58.614303 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: WARNING keystonemiddleware.auth_token [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 00:35:58.620924 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: WARNING keystonemiddleware.auth_token [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 00:35:58.956581 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: WARNING keystonemiddleware.auth_token [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 00:35:58.962394 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: WARNING keystonemiddleware.auth_token [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 00:35:58.967931 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: WARNING keystonemiddleware.auth_token [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 00:35:58.968188 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d655ae59c0 pid: 112170 (default app) Sep 15 00:35:58.970242 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:35:58.971415 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001720 Sep 15 00:35:58.971847 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Thu Sep 15 00:35:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:35:58.973947 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: WARNING keystonemiddleware.auth_token [None req-861ba70f-c21c-413f-8413-a1e4bebaf20f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 00:35:58.979240 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d655ae59c0 pid: 112171 (default app) Sep 15 00:37:19.878759 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:19.879801 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Sep 15 00:37:19.880206 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:19.897432 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=3 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:19.898903 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_cell0:SELECT=3 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:19.899883 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_cell1:SELECT=3 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:19.901084 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:20.778013 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-97cf582d-b46d-4f24-97f3-1b1c7375330b admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:20.810963 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-97cf582d-b46d-4f24-97f3-1b1c7375330b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923885 Sep 15 00:37:20.811938 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 15 00:37:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:37:23.418852 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:23.419937 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-39db8de2-8fd9-4284-9bec-ec171574a806 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 15 00:37:23.420343 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:23.884583 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-73a05e13-d6c2-4c01-b710-e3425ab6a7db admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:23.931629 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-73a05e13-d6c2-4c01-b710-e3425ab6a7db admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505013 Sep 15 00:37:23.932466 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:37:23.947309 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:SELECT=3 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:23.949547 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_cell0:SELECT=3 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:23.950289 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_cell1:SELECT=3 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:23.951032 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:24.161457 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-d974a63e-2323-480f-bf37-e5be39f8d59b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:24.229514 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-d974a63e-2323-480f-bf37-e5be39f8d59b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287776 Sep 15 00:37:24.230035 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 00:37:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:37:26.834037 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-73a05e13-d6c2-4c01-b710-e3425ab6a7db admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:26.835056 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-73a05e13-d6c2-4c01-b710-e3425ab6a7db admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 15 00:37:26.835536 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:27.478928 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-7fd8f781-7d2d-4a85-acb5-e7e53647bb22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:27.520367 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-7fd8f781-7d2d-4a85-acb5-e7e53647bb22 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676004 Sep 15 00:37:27.523653 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:37:27.533569 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-0b80f4ff-9a2b-462d-8b28-9347836a0f79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:27.586098 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-0b80f4ff-9a2b-462d-8b28-9347836a0f79 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056339 Sep 15 00:37:27.586849 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 00:37:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:37:30.157155 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-7fd8f781-7d2d-4a85-acb5-e7e53647bb22 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:30.158166 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-7fd8f781-7d2d-4a85-acb5-e7e53647bb22 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 15 00:37:30.158570 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:30.584828 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-63be4a4e-514b-4658-a95b-f9f818f01798 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "disk": 10, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:30.604957 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-63be4a4e-514b-4658-a95b-f9f818f01798 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439347 Sep 15 00:37:30.605510 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 00:37:30.617665 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-b11bbd72-7552-4b4c-b5e2-4652cd55d124 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:30.648941 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-b11bbd72-7552-4b4c-b5e2-4652cd55d124 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034378 Sep 15 00:37:30.650162 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 00:37:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:37:33.242116 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-63be4a4e-514b-4658-a95b-f9f818f01798 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:33.243832 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-63be4a4e-514b-4658-a95b-f9f818f01798 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002269 Sep 15 00:37:33.244459 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:33.658973 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-9efc70bb-8d64-4848-8221-d72738a3312e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "id": "d3", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:33.684004 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-9efc70bb-8d64-4848-8221-d72738a3312e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433522 Sep 15 00:37:33.684772 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:37:33.697463 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-913c5f0d-2247-4fa8-8add-eb094b5dfb25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:33.724928 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-913c5f0d-2247-4fa8-8add-eb094b5dfb25 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031678 Sep 15 00:37:33.725700 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 00:37:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:37:36.308132 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-9efc70bb-8d64-4848-8221-d72738a3312e admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:36.309143 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-9efc70bb-8d64-4848-8221-d72738a3312e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 15 00:37:36.309545 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:36.709104 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-bb9e568a-c62f-49a6-9a15-1323d4964035 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "vcpus": 4}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:36.731201 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-bb9e568a-c62f-49a6-9a15-1323d4964035 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415191 Sep 15 00:37:36.732433 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:37:36.744703 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-a36eaed1-7b2c-4d73-98e7-fbdd3aa1bd07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:36.769313 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-a36eaed1-7b2c-4d73-98e7-fbdd3aa1bd07 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028870 Sep 15 00:37:36.769880 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 15 00:37:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:37:39.454447 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-bb9e568a-c62f-49a6-9a15-1323d4964035 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:39.455773 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-bb9e568a-c62f-49a6-9a15-1323d4964035 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001788 Sep 15 00:37:39.456304 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:39.868949 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-3091c052-fe92-4a0f-9374-8ce1580c2f00 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:39.894116 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-3091c052-fe92-4a0f-9374-8ce1580c2f00 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.431281 Sep 15 00:37:39.894664 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 15 00:37:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:37:42.524056 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-bb9e568a-c62f-49a6-9a15-1323d4964035 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:42.525787 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-bb9e568a-c62f-49a6-9a15-1323d4964035 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 Sep 15 00:37:42.526682 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:42.982884 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-eb77e90d-ff91-4498-a882-95e379a3132f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "rxtx_factor": 1.0}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:43.003997 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-eb77e90d-ff91-4498-a882-95e379a3132f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.470229 Sep 15 00:37:43.004543 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:37:43.016492 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-6c2692bb-625f-42bc-8f16-527eb630cbc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:43.044724 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-6c2692bb-625f-42bc-8f16-527eb630cbc0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031856 Sep 15 00:37:43.045292 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 00:37:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:37:45.651323 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-eb77e90d-ff91-4498-a882-95e379a3132f admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:45.652387 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-eb77e90d-ff91-4498-a882-95e379a3132f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 15 00:37:45.652784 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:46.050759 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-4caca05d-9ef3-42bb-a4f7-eb2e8fbc2b11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:46.071145 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-4caca05d-9ef3-42bb-a4f7-eb2e8fbc2b11 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412274 Sep 15 00:37:46.071659 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:37:46.083528 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-4641f9ac-b81f-4abb-a91e-e666d7785555 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:46.106392 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-4641f9ac-b81f-4abb-a91e-e666d7785555 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026440 Sep 15 00:37:46.106960 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 00:37:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:37:48.704714 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-4caca05d-9ef3-42bb-a4f7-eb2e8fbc2b11 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:48.705771 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-4caca05d-9ef3-42bb-a4f7-eb2e8fbc2b11 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 15 00:37:48.706173 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:49.086704 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-7dac2dfb-e534-4d93-ae53-5ea47d4c35bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "vcpus": 2, "swap": 0, "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:49.113630 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-7dac2dfb-e534-4d93-ae53-5ea47d4c35bd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.397113 Sep 15 00:37:49.114392 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:37:49.126780 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-bcb163e5-3acd-4063-90b0-fba35d8c43c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:49.158084 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-bcb163e5-3acd-4063-90b0-fba35d8c43c6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035095 Sep 15 00:37:49.159057 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 00:37:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:37:51.767258 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-7dac2dfb-e534-4d93-ae53-5ea47d4c35bd admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:51.768250 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-7dac2dfb-e534-4d93-ae53-5ea47d4c35bd admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 15 00:37:51.772092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:52.222284 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-10090b21-9481-4067-9e3c-711a9fc1274a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "id": "4", "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:52.230809 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:52.250369 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-10090b21-9481-4067-9e3c-711a9fc1274a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474872 Sep 15 00:37:52.251519 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 00:37:52.263833 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-948bdf4a-694d-49b0-bed8-47d12e9d6d28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:52.292591 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-948bdf4a-694d-49b0-bed8-47d12e9d6d28 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032354 Sep 15 00:37:52.295631 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 00:37:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:37:54.964587 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-10090b21-9481-4067-9e3c-711a9fc1274a admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:37:54.966397 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-10090b21-9481-4067-9e3c-711a9fc1274a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002241 Sep 15 00:37:54.967035 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:37:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:37:55.437395 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-52c3542d-5054-497b-880c-4dc4568dbe05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "name": "m1.xlarge"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:55.446014 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:55.466755 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-52c3542d-5054-497b-880c-4dc4568dbe05 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.493677 Sep 15 00:37:55.467302 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 15 00:37:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:37:55.480454 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-129f2d2e-3856-4f52-9cfe-008e1c4d8343 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:37:55.504655 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-129f2d2e-3856-4f52-9cfe-008e1c4d8343 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028969 Sep 15 00:37:55.505311 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 15 00:37:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:38:14.893153 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-52c3542d-5054-497b-880c-4dc4568dbe05 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:14.894076 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-52c3542d-5054-497b-880c-4dc4568dbe05 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 15 00:38:14.894478 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:38:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:14.905366 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:15.277791 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-9b021412-9863-443f-aac6-581aa4424769 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:15.295500 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-9b021412-9863-443f-aac6-581aa4424769 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394469 Sep 15 00:38:15.296027 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 15 00:38:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:38:16.597756 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-52c3542d-5054-497b-880c-4dc4568dbe05 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:16.598752 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-52c3542d-5054-497b-880c-4dc4568dbe05 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 15 00:38:16.599154 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:17.127033 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-802f12f5-92c5-4deb-bb8b-e11a9d351b0e admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:17.132530 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.wsgi [None req-802f12f5-92c5-4deb-bb8b-e11a9d351b0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-802f12f5-92c5-4deb-bb8b-e11a9d351b0e admin admin] Request method failure captured: Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Accept: application/json Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Accept-Encoding: gzip, deflate Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Connection: keep-alive Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Content-Length: 0 Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Host: 10.222.0.15 Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Openstack-Api-Version: compute 2.92 Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Openstack-System-Scope: None Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: User-Agent: python-novaclient Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Auth-Token: gAAAAABjInP4WOV1N9UfaNHU_ZFbdjRPgEqqcU6xvV3VgfZHb-GnQ-eswBNL4O5H7Jwy6Rj4LQH8IWAPYhyaWpizOyBCXAGWDyg2QmwYBgFzxTXYo1YnjaByjq5FMdbNk1sEQI3lwrKsXrffn4zZe1ueebe-5Sh3wLYuJ6xciCfGdUJBmzY6GHc Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Domain-Id: None Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Domain-Name: None Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Identity-Status: Confirmed Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Is-Admin-Project: True Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Domain-Id: default Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Domain-Name: Default Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Name: admin Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Role: member,admin,reader Sep 15 00:38:17.135796 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Roles: member,admin,reader Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e1704ba0a17f4363ab56f84c09fdea08", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e1704ba0a17f4363ab56f84c09fdea08"}]}] Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant: admin Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant-Name: admin Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User: admin Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Domain-Id: default Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Domain-Name: Default Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Id: 34b8b29876a54a4285fc37bd5edb4042 Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Name: admin Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: method: > Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: exception: Flavor 42 could not be found. Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: action_args: {'id': '42'} Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:38:17.137168 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:17.138039 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.139419 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-802f12f5-92c5-4deb-bb8b-e11a9d351b0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:38:17.140711 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-802f12f5-92c5-4deb-bb8b-e11a9d351b0e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394652 Sep 15 00:38:17.140711 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 15 00:38:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:17.146959 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-111b85bc-d565-46a1-ac37-899064ce8399 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:17.169744 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-111b85bc-d565-46a1-ac37-899064ce8399 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026380 Sep 15 00:38:17.170277 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 00:38:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:38:17.181256 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-297b205f-c9bc-4106-b4a4-f674c42f6210 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:17.202462 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-297b205f-c9bc-4106-b4a4-f674c42f6210 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026272 Sep 15 00:38:17.202988 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 00:38:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:38:17.212399 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-92da2354-9569-4a5c-bac5-1cb97d5cbf02 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:17.217527 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.wsgi [None req-92da2354-9569-4a5c-bac5-1cb97d5cbf02 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-92da2354-9569-4a5c-bac5-1cb97d5cbf02 admin admin] Request method failure captured: Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Accept: application/json Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Accept-Encoding: gzip, deflate Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Connection: keep-alive Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Content-Length: 0 Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Host: 10.222.0.15 Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Openstack-Api-Version: compute 2.92 Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Openstack-System-Scope: None Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: User-Agent: python-novaclient Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Auth-Token: gAAAAABjInP4WOV1N9UfaNHU_ZFbdjRPgEqqcU6xvV3VgfZHb-GnQ-eswBNL4O5H7Jwy6Rj4LQH8IWAPYhyaWpizOyBCXAGWDyg2QmwYBgFzxTXYo1YnjaByjq5FMdbNk1sEQI3lwrKsXrffn4zZe1ueebe-5Sh3wLYuJ6xciCfGdUJBmzY6GHc Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Domain-Id: None Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Domain-Name: None Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Identity-Status: Confirmed Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Is-Admin-Project: True Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Domain-Id: default Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Domain-Name: Default Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Name: admin Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Role: member,admin,reader Sep 15 00:38:17.220911 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Roles: member,admin,reader Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e1704ba0a17f4363ab56f84c09fdea08", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e1704ba0a17f4363ab56f84c09fdea08"}]}] Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant: admin Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant-Name: admin Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User: admin Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Domain-Id: default Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Domain-Name: Default Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Id: 34b8b29876a54a4285fc37bd5edb4042 Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Name: admin Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: method: > Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: exception: Flavor 42 could not be found. Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: action_args: {'id': '42'} Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:38:17.222386 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:17.223396 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:17.224674 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-92da2354-9569-4a5c-bac5-1cb97d5cbf02 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:38:17.226390 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-92da2354-9569-4a5c-bac5-1cb97d5cbf02 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013715 Sep 15 00:38:17.226390 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 15 00:38:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 00:38:18.442963 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-297b205f-c9bc-4106-b4a4-f674c42f6210 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:18.444052 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-297b205f-c9bc-4106-b4a4-f674c42f6210 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 15 00:38:18.444448 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:38:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:18.964351 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-e6b45f10-96db-483e-87aa-c3d627182c42 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:18.969187 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.wsgi [None req-e6b45f10-96db-483e-87aa-c3d627182c42 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-e6b45f10-96db-483e-87aa-c3d627182c42 admin admin] Request method failure captured: Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Accept: application/json Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Accept-Encoding: gzip, deflate Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Connection: keep-alive Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Content-Length: 0 Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Host: 10.222.0.15 Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Openstack-Api-Version: compute 2.92 Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Openstack-System-Scope: None Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: User-Agent: python-novaclient Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Auth-Token: gAAAAABjInP60oiEPv-ugNaGxFvGdXm5xb-Di5_asnz3_49IubcKhRi-y5WK4UPS4-0wsuONyChc0xmK-lqmYV41rJmOmYc7bDZxL8SooKKC6x8PBoam7IQKzhX_CRVwXKbaa0FsGsF3BQFdv9D7zcLnpyHEPZMNUbdUrHCf_8fzHxn3XLxmBMA Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Domain-Id: None Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Domain-Name: None Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Identity-Status: Confirmed Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Is-Admin-Project: True Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Domain-Id: default Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Domain-Name: Default Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Name: admin Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Role: member,admin,reader Sep 15 00:38:18.970681 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Roles: member,admin,reader Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e1704ba0a17f4363ab56f84c09fdea08", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e1704ba0a17f4363ab56f84c09fdea08"}]}] Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant: admin Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant-Name: admin Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User: admin Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Domain-Id: default Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Domain-Name: Default Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Id: 34b8b29876a54a4285fc37bd5edb4042 Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Name: admin Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: method: > Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: exception: Flavor 84 could not be found. Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: action_args: {'id': '84'} Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:38:18.972239 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:18.973072 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:18.974176 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-e6b45f10-96db-483e-87aa-c3d627182c42 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:38:18.975384 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-e6b45f10-96db-483e-87aa-c3d627182c42 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391353 Sep 15 00:38:18.975384 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 15 00:38:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:18.981897 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-2a664edb-5ff9-4483-bc99-de2cddfbaba6 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:18.996997 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-2a664edb-5ff9-4483-bc99-de2cddfbaba6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018794 Sep 15 00:38:18.997537 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 00:38:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:38:19.007531 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-8bed27b9-2718-4298-99b1-2e0a0a71ec37 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:19.022348 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-8bed27b9-2718-4298-99b1-2e0a0a71ec37 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019149 Sep 15 00:38:19.022855 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 00:38:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:38:19.031812 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-9479f74c-6a3c-47f8-8c10-7db423a05f3f admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:19.036662 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.wsgi [None req-9479f74c-6a3c-47f8-8c10-7db423a05f3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-9479f74c-6a3c-47f8-8c10-7db423a05f3f admin admin] Request method failure captured: Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Accept: application/json Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Accept-Encoding: gzip, deflate Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Connection: keep-alive Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Content-Length: 0 Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Host: 10.222.0.15 Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Openstack-Api-Version: compute 2.92 Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Openstack-System-Scope: None Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: User-Agent: python-novaclient Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Auth-Token: gAAAAABjInP60oiEPv-ugNaGxFvGdXm5xb-Di5_asnz3_49IubcKhRi-y5WK4UPS4-0wsuONyChc0xmK-lqmYV41rJmOmYc7bDZxL8SooKKC6x8PBoam7IQKzhX_CRVwXKbaa0FsGsF3BQFdv9D7zcLnpyHEPZMNUbdUrHCf_8fzHxn3XLxmBMA Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Domain-Id: None Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Domain-Name: None Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Identity-Status: Confirmed Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Is-Admin-Project: True Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Domain-Id: default Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Domain-Name: Default Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Name: admin Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Role: member,admin,reader Sep 15 00:38:19.038151 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Roles: member,admin,reader Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e1704ba0a17f4363ab56f84c09fdea08", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e1704ba0a17f4363ab56f84c09fdea08"}]}] Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant: admin Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant-Name: admin Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User: admin Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Domain-Id: default Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Domain-Name: Default Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Id: 34b8b29876a54a4285fc37bd5edb4042 Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Name: admin Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: method: > Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: exception: Flavor 84 could not be found. Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: action_args: {'id': '84'} Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:38:19.039766 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:19.040804 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:19.042228 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-9479f74c-6a3c-47f8-8c10-7db423a05f3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:38:19.043524 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-9479f74c-6a3c-47f8-8c10-7db423a05f3f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011140 Sep 15 00:38:19.043524 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 15 00:38:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:20.279600 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-8bed27b9-2718-4298-99b1-2e0a0a71ec37 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:20.280732 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-8bed27b9-2718-4298-99b1-2e0a0a71ec37 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Sep 15 00:38:20.281136 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:20.798990 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-98d79b76-b8c8-49b5-ba32-0d453902a7e1 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:20.805625 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.wsgi [None req-98d79b76-b8c8-49b5-ba32-0d453902a7e1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-98d79b76-b8c8-49b5-ba32-0d453902a7e1 admin admin] Request method failure captured: Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Accept: application/json Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Accept-Encoding: gzip, deflate Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Connection: keep-alive Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Content-Length: 0 Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Host: 10.222.0.15 Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Openstack-Api-Version: compute 2.92 Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Openstack-System-Scope: None Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: User-Agent: python-novaclient Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Auth-Token: gAAAAABjInP8UaI-gDLCuvLHqn57-9htPFmWZsYrVh2utMxr704_1TTgh8V2S_bIaVUXhIUm8BOBgXQNyljfFuQqYKRl3l1W0A0ddeft45D08YpFLn_KbuGGukJLPkfQFjQOxW0wP7I9y1Vq1wuw1Is8RVfa-LxGSEninBud7dRDcTgjtIE45qc Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Domain-Id: None Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Domain-Name: None Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Identity-Status: Confirmed Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Is-Admin-Project: True Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Domain-Id: default Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Domain-Name: Default Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Project-Name: admin Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Role: member,admin,reader Sep 15 00:38:20.807169 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Roles: member,admin,reader Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e1704ba0a17f4363ab56f84c09fdea08", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e1704ba0a17f4363ab56f84c09fdea08"}]}] Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant: admin Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-Tenant-Name: admin Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User: admin Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Domain-Id: default Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Domain-Name: Default Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Id: 34b8b29876a54a4285fc37bd5edb4042 Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: X-User-Name: admin Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: method: > Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: exception: Flavor 451 could not be found. Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: action_args: {'id': '451'} Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:38:20.808721 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:20.809683 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.811058 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-98d79b76-b8c8-49b5-ba32-0d453902a7e1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:38:20.812465 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-98d79b76-b8c8-49b5-ba32-0d453902a7e1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390817 Sep 15 00:38:20.812465 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 00:38:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:20.818336 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-bae35869-6b55-4d40-896a-9ce8ab2dddb3 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:20.832932 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-bae35869-6b55-4d40-896a-9ce8ab2dddb3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018131 Sep 15 00:38:20.833446 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 00:38:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:38:20.842678 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:20.858466 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019219 Sep 15 00:38:20.858988 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 15 00:38:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:38:20.869031 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-82d3e50e-3656-4f6c-83bf-020e8ca33064 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:20.874019 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.wsgi [None req-82d3e50e-3656-4f6c-83bf-020e8ca33064 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-82d3e50e-3656-4f6c-83bf-020e8ca33064 admin admin] Request method failure captured: Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Accept: application/json Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Accept-Encoding: gzip, deflate Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Connection: keep-alive Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Content-Length: 0 Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Host: 10.222.0.15 Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Openstack-Api-Version: compute 2.92 Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Openstack-System-Scope: None Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: User-Agent: python-novaclient Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Auth-Token: gAAAAABjInP8UaI-gDLCuvLHqn57-9htPFmWZsYrVh2utMxr704_1TTgh8V2S_bIaVUXhIUm8BOBgXQNyljfFuQqYKRl3l1W0A0ddeft45D08YpFLn_KbuGGukJLPkfQFjQOxW0wP7I9y1Vq1wuw1Is8RVfa-LxGSEninBud7dRDcTgjtIE45qc Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Domain-Id: None Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Domain-Name: None Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Identity-Status: Confirmed Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Is-Admin-Project: True Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Domain-Id: default Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Domain-Name: Default Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Project-Name: admin Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Role: member,admin,reader Sep 15 00:38:20.875548 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Roles: member,admin,reader Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e1704ba0a17f4363ab56f84c09fdea08", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e1704ba0a17f4363ab56f84c09fdea08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e1704ba0a17f4363ab56f84c09fdea08"}]}] Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant: admin Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant-Id: e1704ba0a17f4363ab56f84c09fdea08 Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-Tenant-Name: admin Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User: admin Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Domain-Id: default Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Domain-Name: Default Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Id: 34b8b29876a54a4285fc37bd5edb4042 Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: X-User-Name: admin Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: method: > Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: exception: Flavor 451 could not be found. Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: action_args: {'id': '451'} Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:38:20.877092 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:20.878142 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Sep 15 00:38:20.879775 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-82d3e50e-3656-4f6c-83bf-020e8ca33064 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:38:20.881032 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-82d3e50e-3656-4f6c-83bf-020e8ca33064 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012043 Sep 15 00:38:20.881032 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 00:38:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:22.083873 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:22.084913 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 15 00:38:22.085479 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:22.604208 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-298d68ac-b024-4d88-8513-825384487f43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:38:22.623720 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-298d68ac-b024-4d88-8513-825384487f43 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402492 Sep 15 00:38:22.624252 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 15 00:38:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:38:23.836494 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:23.837504 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 15 00:38:23.837903 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:24.474458 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-8f9f5035-49a5-48c2-94f7-ebd0e36d7ca0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:38:24.493095 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-8f9f5035-49a5-48c2-94f7-ebd0e36d7ca0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.514187 Sep 15 00:38:24.493561 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 15 00:38:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:38:25.713500 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:25.714515 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 15 00:38:25.714904 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:26.234402 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-81ec0c71-e672-49ac-b1f4-36e18caa44e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:38:26.253434 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-81ec0c71-e672-49ac-b1f4-36e18caa44e7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400843 Sep 15 00:38:26.253974 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 15 00:38:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:38:27.466086 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:27.467098 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 15 00:38:27.467514 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:27.982732 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-e83aa800-fc07-4587-89cc-f6ed60929664 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:38:28.001014 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-e83aa800-fc07-4587-89cc-f6ed60929664 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.394755 Sep 15 00:38:28.001553 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 15 00:38:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:38:29.217693 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:29.218694 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 15 00:38:29.219088 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:38:29.734691 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-c66a8d93-2ed3-4313-9ab2-366fdd883070 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:38:29.755014 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-c66a8d93-2ed3-4313-9ab2-366fdd883070 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397320 Sep 15 00:38:29.755555 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Thu Sep 15 00:38:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:39:26.232568 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:39:26.233493 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-c538f77f-4089-4d7c-a5bd-e32dd02237ad admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 15 00:39:26.233898 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 15 00:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:39:26.244881 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:26.619762 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-a0fd0bfa-fd2d-43e0-94f9-c81aca2dc0f1 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:39:26.639699 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-a0fd0bfa-fd2d-43e0-94f9-c81aca2dc0f1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399996 Sep 15 00:39:26.640233 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 15 00:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:39:26.661527 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=14 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:26.666137 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-749626d2-8919-49ea-8609-632fbf8c0213 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:39:26.673550 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-749626d2-8919-49ea-8609-632fbf8c0213 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013321 Sep 15 00:39:26.673982 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Thu Sep 15 00:39:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:39:26.685598 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-a7941050-e749-4c27-8e42-507ae2ff1608 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:39:26.692821 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-a7941050-e749-4c27-8e42-507ae2ff1608 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010814 Sep 15 00:39:26.693330 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Thu Sep 15 00:39:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:39:26.704828 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:39:26.712765 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011496 Sep 15 00:39:26.713292 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Thu Sep 15 00:39:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:39:26.724429 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-f7b6f593-8e18-4c13-bc7b-6a818440d602 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:39:26.732203 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-f7b6f593-8e18-4c13-bc7b-6a818440d602 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011303 Sep 15 00:39:26.732715 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Thu Sep 15 00:39:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:42:30.786146 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:42:30.787808 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Sep 15 00:42:30.788203 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:42:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:42:30.927813 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:SELECT=6 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:42:31.082897 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-41e1520e-5bdb-4a76-bb2f-3f1e8509db8c admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:42:31.088252 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-41e1520e-5bdb-4a76-bb2f-3f1e8509db8c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:42:31.088728 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-41e1520e-5bdb-4a76-bb2f-3f1e8509db8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:42:31.089160 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-41e1520e-5bdb-4a76-bb2f-3f1e8509db8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:42:31.089880 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-41e1520e-5bdb-4a76-bb2f-3f1e8509db8c admin admin] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:42:31.090332 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-41e1520e-5bdb-4a76-bb2f-3f1e8509db8c admin admin] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:42:31.090753 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-41e1520e-5bdb-4a76-bb2f-3f1e8509db8c admin admin] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:42:31.121365 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-41e1520e-5bdb-4a76-bb2f-3f1e8509db8c admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.194821 Sep 15 00:42:31.121891 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 00:42:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:42:32.199286 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:42:32.200327 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 15 00:42:32.200724 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:42:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:42:32.389569 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-d7b16f34-ba21-4372-a67a-fe29536f9ffa admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:42:32.392962 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-d7b16f34-ba21-4372-a67a-fe29536f9ffa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:42:32.393437 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-d7b16f34-ba21-4372-a67a-fe29536f9ffa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:42:32.393865 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-d7b16f34-ba21-4372-a67a-fe29536f9ffa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:42:32.394572 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-d7b16f34-ba21-4372-a67a-fe29536f9ffa admin admin] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:42:32.395016 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-d7b16f34-ba21-4372-a67a-fe29536f9ffa admin admin] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:42:32.395432 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-d7b16f34-ba21-4372-a67a-fe29536f9ffa admin admin] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:42:32.414902 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-d7b16f34-ba21-4372-a67a-fe29536f9ffa admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.073700 Sep 15 00:42:32.415439 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 00:42:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:42:43.900288 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:42:43.901288 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 15 00:42:43.901681 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:42:44.049426 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_cell0:SELECT=4 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:42:44.050073 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_cell1:SELECT=4 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:42:44.050753 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:SELECT=8 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:42:44.097798 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-4ee5e4bf-8d40-4816-bc72-624f6a49da97 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:42:44.101139 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-4ee5e4bf-8d40-4816-bc72-624f6a49da97 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:42:44.101734 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-4ee5e4bf-8d40-4816-bc72-624f6a49da97 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:42:44.102178 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-4ee5e4bf-8d40-4816-bc72-624f6a49da97 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:42:44.102881 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-4ee5e4bf-8d40-4816-bc72-624f6a49da97 admin admin] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:42:44.103322 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-4ee5e4bf-8d40-4816-bc72-624f6a49da97 admin admin] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:42:44.103763 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-4ee5e4bf-8d40-4816-bc72-624f6a49da97 admin admin] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:42:44.128354 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-4ee5e4bf-8d40-4816-bc72-624f6a49da97 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.083391 Sep 15 00:42:44.128889 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 00:42:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:42:45.206052 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:42:45.207050 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-af0e0084-9c11-40f6-8dd2-f002dae75041 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Sep 15 00:42:45.207441 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 15 00:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:42:45.398955 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-c9e36f9d-7f46-4d31-ba3e-e62b6cced402 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:42:45.402344 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-c9e36f9d-7f46-4d31-ba3e-e62b6cced402 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:42:45.402814 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-c9e36f9d-7f46-4d31-ba3e-e62b6cced402 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:42:45.403235 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-c9e36f9d-7f46-4d31-ba3e-e62b6cced402 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:42:45.403968 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-c9e36f9d-7f46-4d31-ba3e-e62b6cced402 admin admin] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:42:45.404410 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-c9e36f9d-7f46-4d31-ba3e-e62b6cced402 admin admin] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:42:45.404819 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-c9e36f9d-7f46-4d31-ba3e-e62b6cced402 admin admin] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:42:45.425454 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-c9e36f9d-7f46-4d31-ba3e-e62b6cced402 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.078320 Sep 15 00:42:45.425931 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 15 00:42:45 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:43:44.850520 dv-cinder-857528-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 15 00:43:44.851129 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: Thu Sep 15 00:43:44 2022 - graceful shutdown triggered... Sep 15 00:43:44.851610 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: Gracefully killing worker 2 (pid: 112171)... Sep 15 00:43:44.851968 dv-cinder-857528-2-iscsi devstack@n-api.service[112170]: Gracefully killing worker 1 (pid: 112170)... Sep 15 00:43:44.976192 dv-cinder-857528-2-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=4 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:43:45.852240 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: worker 1 buried after 1 seconds Sep 15 00:43:45.852758 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: worker 2 buried after 1 seconds Sep 15 00:43:45.852758 dv-cinder-857528-2-iscsi devstack@n-api.service[112169]: goodbye to uWSGI. Sep 15 00:43:45.853834 dv-cinder-857528-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 15 00:43:45.854401 dv-cinder-857528-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 15 00:43:45.857280 dv-cinder-857528-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 00:43:45.866713 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 00:43:45 2022] *** Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: nodename: dv-cinder-857528-2-iscsi Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: machine: x86_64 Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: clock source: unix Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: pcre jit disabled Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: detected number of CPU cores: 4 Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: current working directory: / Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: detected binary path: /usr/bin/uwsgi-core Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: your processes number limit is 47680 Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: your memory page size is 4096 bytes Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: detected max file descriptor number: 2048 Sep 15 00:43:45.868855 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: lock engine: pthread robust mutexes Sep 15 00:43:45.869775 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: thunder lock: enabled Sep 15 00:43:45.869775 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 00:43:45.869775 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 00:43:45.909343 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: Python main interpreter initialized at 0x55c1d4c589c0 Sep 15 00:43:45.909343 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: python threads support enabled Sep 15 00:43:45.909343 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: your server socket listen backlog is limited to 100 connections Sep 15 00:43:45.909343 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: your mercy for graceful operations on workers is 90 seconds Sep 15 00:43:45.909775 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 00:43:45.909775 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: *** Operational MODE: preforking *** Sep 15 00:43:45.910038 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: *** uWSGI is running in multiple interpreter mode *** Sep 15 00:43:45.910038 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: spawned uWSGI master process (pid: 127183) Sep 15 00:43:45.910245 dv-cinder-857528-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 00:43:45.911294 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: spawned uWSGI worker 1 (pid: 127199, cores: 1) Sep 15 00:43:45.911864 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: spawned uWSGI worker 2 (pid: 127200, cores: 1) Sep 15 00:43:45.922144 dv-cinder-857528-2-iscsi devstack@n-api.service[127183]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 00:43:46.568427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 00:43:46.572838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 00:43:47.724842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:43:47.724842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: from cryptography.utils import int_from_bytes Sep 15 00:43:47.725464 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:43:47.725464 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: from cryptography.utils import int_from_bytes Sep 15 00:43:47.727281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:43:47.727281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: from cryptography.utils import int_from_bytes Sep 15 00:43:47.727281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:43:47.727281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: from cryptography.utils import int_from_bytes Sep 15 00:43:50.121153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 00:43:50.121837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 00:43:50.122060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 00:43:50.122321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 00:43:50.122585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 00:43:50.122988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.123296 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.123659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.123974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.124443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.124607 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.124955 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.125259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.125591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.125856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.126173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.126665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857528-2-iscsi {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.126994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.127308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.127660 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.127989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.128299 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.128627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.128942 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.129492 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.130244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.130560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.130885 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.131231 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.131842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.132158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.132497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.132799 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.133138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.133442 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.133863 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857528-2-iscsi {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.134389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.134705 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.135053 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.135475 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.135816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.136130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.136456 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.136782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.137095 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.137445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.137769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.138093 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.138417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.138722 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.139067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.139352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.139711 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.140023 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.140331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.140581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.140897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.141224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.141544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.141874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.142126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.142377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.142700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.143020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.143330 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.143669 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.143981 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.144468 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.144779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.145606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.145918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.146230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.146555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.146884 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.147211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.147543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.147868 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.148285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.148538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.148850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.149197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.149521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.149843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.150166 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.152878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.153207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.153807 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.154395 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.154920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.155241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.155743 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.156046 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.156356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.157052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.157343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.157663 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.157979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.158294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.158608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.158923 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.159233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.159595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.160159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.161408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.162028 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.162630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.162966 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.163314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.163662 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.163996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.164335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.164657 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.164971 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.165302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.165618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.165930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.166532 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.167132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.167721 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.168287 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.168692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.169012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.169327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.169640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.169957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.170272 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.170585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.170896 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.171203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.171552 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.171882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.172197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.172508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.172817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.173141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.173489 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.173825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.174176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.174496 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.174837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.175174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.175558 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.175849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.176169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.176557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.177046 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.177180 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.178253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.178253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.178253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.178511 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.178739 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.179051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.179373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.179788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.180120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.180454 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.180784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.187506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.187506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.187506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.187506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.187506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.187506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.187506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.187506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.188691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.189196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.189196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.189196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.189462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.189791 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.190092 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.190479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.190706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.191014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.191319 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.191670 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.192042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.192182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 00:43:50.192596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.192690 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 00:43:50.192775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.192975 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.193078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 00:43:50.193289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.193383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 00:43:50.193597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 00:43:50.193717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.193909 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.194009 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.194219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.194332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.194525 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.194630 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.194843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.194943 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.195149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.195257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.195531 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.195632 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.195811 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.196060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.196219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.196374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.196521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.196665 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.196809 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.196952 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.197103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.197264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.197408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.197561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857528-2-iscsi {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.197706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.197862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.198026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.198178 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.198322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.198473 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.198619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.198811 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.198978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.199131 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.199284 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.199429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.199613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.199792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.199970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.200141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.200304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.200478 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.200625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.200801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.200950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.201114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.201259 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.201410 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.201556 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.201709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.201893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.202047 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.202202 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.202358 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.202510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.202673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.202831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.202976 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.203128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.203281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.203439 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.203653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.203819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.203974 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857528-2-iscsi {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.205788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.205958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.206185 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.206334 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.206487 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.206632 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.206776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.206935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.207090 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.207243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.207388 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.208057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.208209 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.208367 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.208520 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.208674 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.208819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.208974 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.209129 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.209275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.209419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.209571 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.209716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.209716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.210151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.210304 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.210460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.210647 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.210794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.210937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.211090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.211236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.211380 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.211543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.211693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.211836 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.212006 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.212166 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.212326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.212479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.212634 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.212779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.212923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.213081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.213235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.213387 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.213539 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.213684 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.213828 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.213997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.214152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.214152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.214868 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.215042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.215436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.215638 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.215788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.215933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.216089 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.216277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.216436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.216591 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.216736 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.216881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.217025 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.217251 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.217409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.217564 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.217716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.217868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.218013 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.218171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.218324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.218551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.218699 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.218852 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.219005 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.219159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.219312 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.219457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.219670 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.219820 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.219965 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.219965 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.220347 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.220347 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.220645 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.220791 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.220942 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.221100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.221254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.221254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.221544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.221698 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.221856 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.222152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.222344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.222511 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.222669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.222833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.222994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.223246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.223919 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.224075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.224229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.224403 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.224830 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.225081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.225246 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.225614 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.225765 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.225920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.226089 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.226237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.226433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.226621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.226771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.226931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.227076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.227227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.227380 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.227574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.227726 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.227880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.228037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.228181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.228326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.228477 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.228630 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.228788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.228933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.229085 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.229238 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.229542 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.229696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.229855 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.230002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.230158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.230420 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.230584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.230744 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.230896 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.231048 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.231193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.231337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.231508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.231677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.231857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.232012 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.232159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.232314 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.232460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.232613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.232759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.232914 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.233067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.233226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.233372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.234127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.234302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.234458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.234613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.235184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.235350 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.235796 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.235962 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.236116 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.236272 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.236468 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.236625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.236771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.236917 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.237077 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.237224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.237376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.237529 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.237694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.237840 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.237998 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.238182 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.238331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.238485 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.238637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.238814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.238973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.239119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.239272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.239432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.239620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.239767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.239926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.240071 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.240225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.240379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.240623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.240788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.240934 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.241078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.241231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.241383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.241528 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.241697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.241844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.241844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.242126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.242279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.242423 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.242577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.242757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.242905 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.243056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.243201 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.243353 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.243545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:43:50.243724 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.243878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.244033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.244184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.244333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.244477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.244631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.244803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.245257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.245495 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.245665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.246609 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.246784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.246784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.247075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.247230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.247387 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.247592 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.247743 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.247907 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.248054 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.248206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.248351 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.248515 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.248770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.249011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.249160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.249305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.249458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.249612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.249757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.249910 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.250064 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.250217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.250217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.250491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.250690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.250927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.251090 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.251246 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.251392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.251553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.251722 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.251868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.252022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.252180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.252332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.252477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.252634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.252786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.252931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.252931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.253225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.253378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.253537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.253683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.253834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.253834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.254117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.254117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.254965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.255402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.255667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.255850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.256243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.256700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.256864 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.257019 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.257165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.257318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.257470 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.257624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.257779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.257924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.258076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.258221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.258384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.258543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.258695 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.258848 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.258999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.259145 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.259289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.259443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.259642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.259790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.259934 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.260086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.260245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.260407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.260553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.260698 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.260851 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.261084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.261084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.261381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.261527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.261678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.261834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.261988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.262147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.262291 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.262655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.262807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.262952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.263110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.263270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.263415 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.263597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.263745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.263889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.264047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.264193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.264344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.264500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.264654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.264817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.264972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.265140 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.265571 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.265830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.266006 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.266400 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.266568 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.266768 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.266918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.267072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.267229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.267382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.267664 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.267945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.268097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.268242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.268394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.268548 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.268693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.268846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.268990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.269140 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.269285 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.269469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.270786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.270944 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.271117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.271346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.271522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.271691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.271848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.272003 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.272155 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.272308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.272460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.272614 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.272770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.272922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.272922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.273216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.273376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.273520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.273665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.273809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.273960 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.274106 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.274259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.274405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.274560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.274712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.274905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.275052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.275211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.275394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.276014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.276266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.276653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.276853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.277014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.277160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.277306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.277469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.277623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.277817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.277964 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.278109 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.278255 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.278400 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.278544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.278702 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.278855 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.279009 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.279154 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.279306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.279470 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.279720 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.279874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.280089 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.280237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.280384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.280547 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.280700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.280845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.280990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.281143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.281312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.281544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.281705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.281858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.282003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.282156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.282309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.282465 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.282611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.282756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.282908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.283054 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.283206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.283361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.283527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.283688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.283835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.283990 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.284136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.284294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.284448 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.284603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.284748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.284908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.284908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.285266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.285411 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.285618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.286257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.287259 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.287435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.287606 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.287757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.287903 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.288056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.288203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.288363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.288577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.288730 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.288918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.289121 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.289349 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.289608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.289909 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.290151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.290382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.290615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.290865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.291023 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.291170 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.291317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.291317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.291865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.292347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.292597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.292848 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.293092 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.293485 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.293733 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.293990 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.294152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.294310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.294465 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.294611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.294756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.294922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.295083 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.295229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.295374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.295552 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.295786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.296329 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.296484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.296964 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.297459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.297615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.297775 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.297930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.298088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.298242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.298389 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.298534 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.298695 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.298842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.298994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.299151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.299305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.299506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.299751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.299945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.300095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.300261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.300415 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.300575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.300729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.300888 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.301780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.303070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.303252 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.303432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.303432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.303804 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.303995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.304175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.304355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.304538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.304717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.304909 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.305110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.305110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.305455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.305643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.305850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.306025 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.306480 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.306643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.306805 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.307225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.307225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.307698 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.307874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.308029 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.308176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.308176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.308459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.308618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.308618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.308919 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.309074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.309074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.309074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.309074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.309074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.309777 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.309930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.310076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.310234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.310388 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.310534 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.310679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.310825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.310979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.311518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.311676 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.311919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.312072 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.312237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.312383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.312543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.312688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.312854 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.313059 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.313248 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.313248 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.313617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.313807 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.313987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.314174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.314354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.314558 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.314815 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.315008 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.315188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.315376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.315376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.315746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.315928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.316115 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.316605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.316800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.317871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.318085 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.318275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.318467 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.318655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.318840 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.319041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.319239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.319427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.319678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.319865 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.320063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.320267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.320453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.320652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.320846 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.321041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.321236 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.321434 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.321629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.321816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.322086 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.322277 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.322481 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.322589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.322671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.322752 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.322824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.322902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323001 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323587 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323749 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323824 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323903 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.323990 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324148 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324232 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324312 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324464 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324543 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324768 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.324988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325144 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325297 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325375 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325534 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.325920 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.326069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.326145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.326216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.326287 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.326679 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.326772 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.326856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.326938 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327160 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.327950 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328025 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328194 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328346 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328590 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328738 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328811 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.328972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329482 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329482 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329774 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.329933 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330077 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330308 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330387 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330464 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330607 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330758 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330917 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.330995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331737 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.331892 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.332030 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.332122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.332209 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.332291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.332372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.332444 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.332580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.333936 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334249 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334890 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.334964 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335541 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335747 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335905 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.335985 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.336070 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.336151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.336232 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.336306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.336385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.336473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.336813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.336912 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337157 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.337688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338126 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338441 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.338906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.339060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.339188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.339270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.339348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.339421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.339421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.339640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.339716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340330 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340885 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.340956 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341562 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341898 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.341971 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.342143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.342237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.342432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.342576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.342751 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.342941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.343079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.343267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.343368 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.343978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.344150 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.344317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.344474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.344621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.344621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.345006 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.345177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.345336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.345498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.345650 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.345822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.346054 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.346214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.346380 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.346543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.346543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.347155 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.347310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.347310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.347651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.347806 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.348258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.348419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.348582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.348751 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.348913 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.349066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.349066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.349368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.349368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.349681 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.349836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.350000 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.350160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.350314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.350466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.350634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.350794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.350956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.351116 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.351270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.351421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.351673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.351829 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.351981 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.351981 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.352390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.352390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.352700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.352853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.353014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.353175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.353328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.353489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.353643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.353643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.353939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.353939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.354253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.354253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.354553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.354553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.354852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.355032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.356089 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.356271 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.356435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.356590 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.356750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.357210 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.357392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.357548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.357701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.357853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.358014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.358438 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.358613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.358776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.358930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.359091 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.359260 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.359415 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.359653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.359827 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.360127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.360292 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.360445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.360597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.360759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.360912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.361064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.361064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.361361 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.361523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.361682 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.361846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.361998 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.362150 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.362302 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.362568 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.362736 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.362897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.363056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.363212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.363371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.363559 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.363744 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.363911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.364110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.364275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.364437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.364600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.364760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.364913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.365065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.365234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.365474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.365632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.365794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.365956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.366109 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.366278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.366442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.366595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.366595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.366926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.367366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.367558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.367558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.367995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.367995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.368663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.368857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.369067 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.369067 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.369438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.369626 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.369813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.369990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.370227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.370383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.370537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.370689 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.370849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.371002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.371168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.371370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.371581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.371581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.371889 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.372052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.372213 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.372365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.372516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.372781 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.372940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.373106 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.373267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.373434 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.373586 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.373738 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.373908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.374200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.374359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.374512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.374663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.374824 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.374984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.375152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.375306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.375625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.375806 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.375974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.376137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.376291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.376451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.376604 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.376764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.376919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.377081 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.377482 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.377649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.377803 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.377966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.378130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.378292 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.378582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.378863 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.380147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.380310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.380464 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.380618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.380780 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.380946 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.381101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.381756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.381925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.382080 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.382233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.382396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.382550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.382703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.382965 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.383126 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.383294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.383456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.383683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.383683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.384039 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.384320 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.384491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.384646 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.384799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.384950 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.385110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.385265 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.385434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.385588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.385835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.385994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.386160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.386334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.386499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.386654 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.386806 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.386958 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.387110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.387272 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.387620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.387776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.387940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.388103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.388262 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.388437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.388810 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.389077 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.389243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.389399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.389560 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.389724 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.389886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.390039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.390192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.390351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.390513 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.390687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.390842 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.391005 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.391159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.391311 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.391473 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.391652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.391804 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.391968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.392131 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.392286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.392448 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.392603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.392774 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393293 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393840 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.393934 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394647 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394824 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.394915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.395068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.395857 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396097 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396485 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396799 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.396961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397137 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397222 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397312 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397665 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.397938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 00:43:50.398516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.398516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.399371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.399371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.399371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.399371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.399371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.399371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.399927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.400026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.400281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.400599 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.400929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.401262 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.401591 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.401922 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.402248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.402574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.402899 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.403221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.403635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.403965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.404290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.404627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.404973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.405305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.405630 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.405983 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.406310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.406854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.407180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.407545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.407887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.408222 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.408551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.408941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.409212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.409529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.409844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.410166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.410486 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.410831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.411163 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.411585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.411823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.412152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.412473 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.413021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.413381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.413708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.414044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.414378 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.414710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.415027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.415379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.415734 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.416055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.416398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.416718 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.417033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.417348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.417669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.417990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.418303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.418622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.419028 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.419268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.419634 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.419931 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.420244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.420564 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.420880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.421192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.421505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.421825 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.422147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.422462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.422878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.423193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.424414 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.424824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.425183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.425517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.425866 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.426196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.426552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.426891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.427223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.427589 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.427923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.428252 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.428620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.428954 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.429530 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.429867 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.430675 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.431041 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.431393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.431743 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.432073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.432396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.432737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.433063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.433390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.433718 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.434045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.434366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.434688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.435010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.435332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.435684 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.436009 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.436336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.436656 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.436975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.437296 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.437624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.437979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.438312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.438639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.438966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.439297 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.439654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.439978 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.440300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.440622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.440950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.441290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.441617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.442529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.442975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.443303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.443713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.444051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.444376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.444776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.445632 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.446167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.446692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.447191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.447746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.448294 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.448888 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.449543 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.450146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.450613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.450947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.451285 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.451651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.452008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.452601 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.453156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.453546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.453886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.454212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.454537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.454864 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.455192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.455532 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.455857 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.456181 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.456497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.456816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.457171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.458321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.458573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO dbcounter [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Registered counter for database nova_api Sep 15 00:43:50.459358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.459608 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.460161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.460161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.460552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.460913 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.461271 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.461605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.461949 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.462283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.462706 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.462934 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.463274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.463834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.464458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.465040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.465681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.466304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.466701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.467037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.467372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.467729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.468062 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.468410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.468757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.469079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.469423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.469804 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.470097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.470435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.470761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.471106 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.471432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.471844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.472171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.472503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.472828 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.473188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.473637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.474202 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.474740 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.475265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.475845 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.476392 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.476918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.477464 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.478008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.478369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.478719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.479112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.479465 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.479835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.480274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.480769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:43:50.481145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 00:43:50.482437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_db.sqlalchemy.engines [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:43:50.489010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writer thread running {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:43:50.544640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO dbcounter [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Registered counter for database nova_api Sep 15 00:43:50.545105 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.context [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aaf2701d-e0f5-4078-a270-45cab29cee46(cell1) {{(pid=127199) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 00:43:50.549071 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:43:50.549552 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:43:50.551155 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:43:50.551934 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:43:50.552392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:43:50.554380 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:43:50.556386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO dbcounter [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Registered counter for database nova_cell0 Sep 15 00:43:50.560399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO dbcounter [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Registered counter for database nova_cell1 Sep 15 00:43:50.564936 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_db.sqlalchemy.engines [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:43:50.568729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_db.sqlalchemy.engines [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:43:50.570623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_db.sqlalchemy.engines [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:43:50.572300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writer thread running {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:43:50.574483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writer thread running {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:43:50.628915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.context [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aaf2701d-e0f5-4078-a270-45cab29cee46(cell1) {{(pid=127200) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 00:43:50.633790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:43:50.634268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:43:50.635880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:43:50.636620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:43:50.637074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:43:50.639076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:43:50.641099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO dbcounter [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Registered counter for database nova_cell0 Sep 15 00:43:50.645133 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO dbcounter [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Registered counter for database nova_cell1 Sep 15 00:43:50.653043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_db.sqlalchemy.engines [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:43:50.655230 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_db.sqlalchemy.engines [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:43:50.660228 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writer thread running {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:43:50.665504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writer thread running {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:43:50.714494 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writer thread running {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:43:50.724064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO dbcounter [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Registered counter for database nova_cell0 Sep 15 00:43:50.730629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_db.sqlalchemy.engines [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:43:50.734999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writer thread running {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:43:50.810280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO dbcounter [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Registered counter for database nova_cell0 Sep 15 00:43:50.817112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_db.sqlalchemy.engines [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:43:50.823549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writer thread running {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:43:51.049383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: WARNING keystonemiddleware.auth_token [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 00:43:51.056708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: WARNING keystonemiddleware.auth_token [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 00:43:51.141118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: WARNING keystonemiddleware.auth_token [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 00:43:51.148930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: WARNING keystonemiddleware.auth_token [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 00:43:51.402218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: WARNING keystonemiddleware.auth_token [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 00:43:51.408509 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: WARNING keystonemiddleware.auth_token [None req-5f048ba1-f767-431b-aab1-4b6b3dcfa08a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 00:43:51.414042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1d4c589c0 pid: 127199 (default app) Sep 15 00:43:51.499221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: WARNING keystonemiddleware.auth_token [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 00:43:51.505856 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: WARNING keystonemiddleware.auth_token [None req-1d08d439-ec12-484d-a170-fd90b578b780 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 00:43:51.511405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1d4c589c0 pid: 127200 (default app) Sep 15 00:44:27.095086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:27.095086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:27.095086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:27.095086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:27.355896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=3 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:27.357507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=3 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:27.358787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=3 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:27.359799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=3 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:28.703549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5a5ad06e-bce9-487a-945b-57e55f436723 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Action: 'create', calling method: .version_select at 0x7f2f1df66430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-198761007", "metadata": {"Type": "work"}}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:28.720363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4a64e9a0-b4a5-42f2-b518-c6956a0746fd tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Action: 'create', calling method: .version_select at 0x7f2f1df68430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-625062698", "metadata": {"Type": "work"}}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4a64e9a0-b4a5-42f2-b518-c6956a0746fd tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Request method failure captured: Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 121 Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInVqxT5m02Neh8rXQdjK7mudYpTtXNg2cp6wd32OGVEQ3RWOqWtKT0t601qYfpbBFy1Prx_thICAPfRrdVAAHwa_QhoYJwevbBjtmfvbOGOPniQvBvnMGE7kKdbAc6S_8Z5fnM3j6c9emI9B_vQ-FVxjtFi9RFdzfYN-squxQKSb4f8 Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:44:28.735517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_67568d58a68e4837a58c5432a01ca9fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/67568d58a68e4837a58c5432a01ca9fa"}]}] Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 6401018aba8442ceac151bc6849fb4b2 Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-625062698", "metadata": {"Type": "work"}}} Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: Sep 15 00:44:28.737817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-625062698', 'metadata': {'Type': 'work'}}}} Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise error Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi '#$%' Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:28.738822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 00:44:28.740581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 00:44:28.741866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 00:44:28.741866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:28.741866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4a64e9a0-b4a5-42f2-b518-c6956a0746fd tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:28.741866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4a64e9a0-b4a5-42f2-b518-c6956a0746fd tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.662920 Sep 15 00:44:28.743239 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 15 00:44:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1670 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:44:29.151189 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8a2e076a-ad40-4b6b-8458-2e051defefdf tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Action: 'create', calling method: .version_select at 0x7f2f1df68dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-39751665"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:30.038125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5a5ad06e-bce9-487a-945b-57e55f436723 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.693915 Sep 15 00:44:30.039041 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 1/2] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 15 00:44:27 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2697 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 00:44:30.058231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1586be58-df41-4bf8-b31f-fa40b82d2526 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Action: 'create', calling method: .version_select at 0x7f2f1de3b280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-478056497", "metadata": {"Type": "work"}}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1586be58-df41-4bf8-b31f-fa40b82d2526 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Request method failure captured: Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 119 Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInVqxT5m02Neh8rXQdjK7mudYpTtXNg2cp6wd32OGVEQ3RWOqWtKT0t601qYfpbBFy1Prx_thICAPfRrdVAAHwa_QhoYJwevbBjtmfvbOGOPniQvBvnMGE7kKdbAc6S_8Z5fnM3j6c9emI9B_vQ-FVxjtFi9RFdzfYN-squxQKSb4f8 Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:44:30.088268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_67568d58a68e4837a58c5432a01ca9fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/67568d58a68e4837a58c5432a01ca9fa"}]}] Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 6401018aba8442ceac151bc6849fb4b2 Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-478056497", "metadata": {"Type": "work"}}} Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: Sep 15 00:44:30.089966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-478056497', 'metadata': {'Type': 'work'}}}} Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise error Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi '0' Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:30.090933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 00:44:30.092546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 00:44:30.093894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 00:44:30.093894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.093894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1586be58-df41-4bf8-b31f-fa40b82d2526 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:30.093894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1586be58-df41-4bf8-b31f-fa40b82d2526 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.051784 Sep 15 00:44:30.098140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 15 00:44:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:44:30.110195 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0ee6f357-0122-46bf-a2a5-47a2e4ebb065 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Calling method '.version_select at 0x7f2f1ddcfdc0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:30.361495 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0ee6f357-0122-46bf-a2a5-47a2e4ebb065 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c" status: 200 len: 352 microversion: 2.1 time: 0.260805 Sep 15 00:44:30.370520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:30 2022] GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c => generated 352 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:30.377829 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b26c362e-e158-45c8-88a0-c56ec6802cca tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Action: 'create', calling method: .version_select at 0x7f2f1ddcfca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-734991072", "metadata": {"Type": "work"}}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b26c362e-e158-45c8-88a0-c56ec6802cca tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Request method failure captured: Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 118 Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInVqxT5m02Neh8rXQdjK7mudYpTtXNg2cp6wd32OGVEQ3RWOqWtKT0t601qYfpbBFy1Prx_thICAPfRrdVAAHwa_QhoYJwevbBjtmfvbOGOPniQvBvnMGE7kKdbAc6S_8Z5fnM3j6c9emI9B_vQ-FVxjtFi9RFdzfYN-squxQKSb4f8 Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:44:30.389551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_67568d58a68e4837a58c5432a01ca9fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/67568d58a68e4837a58c5432a01ca9fa"}]}] Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 6401018aba8442ceac151bc6849fb4b2 Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-734991072", "metadata": {"Type": "work"}}} Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: Sep 15 00:44:30.391142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-734991072', 'metadata': {'Type': 'work'}}}} Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise error Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi '' Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:30.392099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 00:44:30.394276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 00:44:30.395639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 00:44:30.395639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.400741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b26c362e-e158-45c8-88a0-c56ec6802cca tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:30.401712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b26c362e-e158-45c8-88a0-c56ec6802cca tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029427 Sep 15 00:44:30.402288 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 4/5] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 15 00:44:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:44:30.422700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1a28190c-9af8-4bce-8d77-8191e198de5d tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Calling method '.version_select at 0x7f2f1de3b430>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:30.482782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8a2e076a-ad40-4b6b-8458-2e051defefdf tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.737488 Sep 15 00:44:30.483586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 2/6] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Sep 15 00:44:28 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 1740 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 00:44:30.499518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1f3a24cb-1bb6-449a-94b6-aedd9d940b81 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1ddf6940>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:30.543261 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-1a28190c-9af8-4bce-8d77-8191e198de5d tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] HTTP exception thrown: Volume tempest-invalid-1136266784 could not be found. Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1a28190c-9af8-4bce-8d77-8191e198de5d tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Request method failure captured: Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1136266784 HTTP/1.1 Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInVqxT5m02Neh8rXQdjK7mudYpTtXNg2cp6wd32OGVEQ3RWOqWtKT0t601qYfpbBFy1Prx_thICAPfRrdVAAHwa_QhoYJwevbBjtmfvbOGOPniQvBvnMGE7kKdbAc6S_8Z5fnM3j6c9emI9B_vQ-FVxjtFi9RFdzfYN-squxQKSb4f8 Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:44:30.550896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_67568d58a68e4837a58c5432a01ca9fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/67568d58a68e4837a58c5432a01ca9fa"}]}] Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 6401018aba8442ceac151bc6849fb4b2 Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Volume tempest-invalid-1136266784 could not be found. Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': 'tempest-invalid-1136266784'} Sep 15 00:44:30.552692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1136266784 could not be found. (HTTP 404) (Request-ID: req-ee84fc5f-38a7-4014-b588-2f383a507ade) Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.553655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 00:44:30.555432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1136266784 could not be found. Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:44:30.556853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1136266784 could not be found. Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1136266784 could not be found. Sep 15 00:44:30.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.563240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1a28190c-9af8-4bce-8d77-8191e198de5d tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Returning 404 to user: Volume tempest-invalid-1136266784 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:30.564188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1a28190c-9af8-4bce-8d77-8191e198de5d tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1136266784" status: 404 len: 99 microversion: 2.1 time: 0.155660 Sep 15 00:44:30.564751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 5/7] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 00:44:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1136266784 => generated 99 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 15 00:44:30.575124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2163f37f-9e16-4147-b118-645780c01061 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003829 Sep 15 00:44:30.582302 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 6/8] 10.222.0.15 () {58 vars in 1140 bytes} [Thu Sep 15 00:44:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 00:44:30.595208 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2a2ed575-ae30-49f1-b8e5-b0e603db88bb tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007952 Sep 15 00:44:30.598396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 7/9] 10.222.0.15 () {58 vars in 1137 bytes} [Thu Sep 15 00:44:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 15 00:44:30.611818 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b4310bc2-14e3-49ec-8bbc-9e5c9819e9d9 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Calling method '.version_select at 0x7f2f1dd63430>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:30.691274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1f3a24cb-1bb6-449a-94b6-aedd9d940b81 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209" status: 200 len: 343 microversion: 2.1 time: 0.196491 Sep 15 00:44:30.692522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 3/10] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:30 2022] GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:44:30.705558 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-40b785a4-a772-4de2-9962-edcbd9c47813 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1de07040>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:30.716848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-b4310bc2-14e3-49ec-8bbc-9e5c9819e9d9 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] HTTP exception thrown: Volume 3abc66b4-1177-47f9-84d3-e28c75e3e117 could not be found. Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b4310bc2-14e3-49ec-8bbc-9e5c9819e9d9 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Request method failure captured: Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: DELETE /compute/v2.1/os-volumes/3abc66b4-1177-47f9-84d3-e28c75e3e117 HTTP/1.1 Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInVqxT5m02Neh8rXQdjK7mudYpTtXNg2cp6wd32OGVEQ3RWOqWtKT0t601qYfpbBFy1Prx_thICAPfRrdVAAHwa_QhoYJwevbBjtmfvbOGOPniQvBvnMGE7kKdbAc6S_8Z5fnM3j6c9emI9B_vQ-FVxjtFi9RFdzfYN-squxQKSb4f8 Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:44:30.719623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_67568d58a68e4837a58c5432a01ca9fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/67568d58a68e4837a58c5432a01ca9fa"}]}] Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 6401018aba8442ceac151bc6849fb4b2 Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Volume 3abc66b4-1177-47f9-84d3-e28c75e3e117 could not be found. Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '3abc66b4-1177-47f9-84d3-e28c75e3e117'} Sep 15 00:44:30.721152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3abc66b4-1177-47f9-84d3-e28c75e3e117 could not be found. (HTTP 404) (Request-ID: req-8f14a421-1992-45b2-aab2-04f64f1efe5c) Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.722614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 00:44:30.723937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3abc66b4-1177-47f9-84d3-e28c75e3e117 could not be found. Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 00:44:30.725199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3abc66b4-1177-47f9-84d3-e28c75e3e117 could not be found. Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3abc66b4-1177-47f9-84d3-e28c75e3e117 could not be found. Sep 15 00:44:30.726484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.728429 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b4310bc2-14e3-49ec-8bbc-9e5c9819e9d9 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Returning 404 to user: Volume 3abc66b4-1177-47f9-84d3-e28c75e3e117 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:30.729464 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b4310bc2-14e3-49ec-8bbc-9e5c9819e9d9 tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/3abc66b4-1177-47f9-84d3-e28c75e3e117" status: 404 len: 109 microversion: 2.1 time: 0.125664 Sep 15 00:44:30.730536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 8/11] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:44:30 2022] DELETE /compute/v2.1/os-volumes/3abc66b4-1177-47f9-84d3-e28c75e3e117 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:44:30.743395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ab9329b4-006c-4b70-82b6-82d28abe1cab tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Calling method '.version_select at 0x7f2f1ddcfd30>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:30.931738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-ab9329b4-006c-4b70-82b6-82d28abe1cab tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] HTTP exception thrown: Volume 7a0a824d-655a-4eed-9f77-963b90c6ead3 could not be found. Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ab9329b4-006c-4b70-82b6-82d28abe1cab tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Request method failure captured: Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/os-volumes/7a0a824d-655a-4eed-9f77-963b90c6ead3 HTTP/1.1 Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInVqxT5m02Neh8rXQdjK7mudYpTtXNg2cp6wd32OGVEQ3RWOqWtKT0t601qYfpbBFy1Prx_thICAPfRrdVAAHwa_QhoYJwevbBjtmfvbOGOPniQvBvnMGE7kKdbAc6S_8Z5fnM3j6c9emI9B_vQ-FVxjtFi9RFdzfYN-squxQKSb4f8 Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:44:30.933693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_67568d58a68e4837a58c5432a01ca9fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67568d58a68e4837a58c5432a01ca9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/67568d58a68e4837a58c5432a01ca9fa"}]}] Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 67568d58a68e4837a58c5432a01ca9fa Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesNegativeTest-164898872 Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 6401018aba8442ceac151bc6849fb4b2 Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesNegativeTest-164898872-project Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Volume 7a0a824d-655a-4eed-9f77-963b90c6ead3 could not be found. Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '7a0a824d-655a-4eed-9f77-963b90c6ead3'} Sep 15 00:44:30.934967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a0a824d-655a-4eed-9f77-963b90c6ead3 could not be found. (HTTP 404) (Request-ID: req-4611d190-52df-4967-bfa4-56e1738cc2d9) Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.935797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:30.972536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a0a824d-655a-4eed-9f77-963b90c6ead3 could not be found. Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 00:44:30.982330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a0a824d-655a-4eed-9f77-963b90c6ead3 could not be found. Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a0a824d-655a-4eed-9f77-963b90c6ead3 could not be found. Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ab9329b4-006c-4b70-82b6-82d28abe1cab tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] Returning 404 to user: Volume 7a0a824d-655a-4eed-9f77-963b90c6ead3 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ab9329b4-006c-4b70-82b6-82d28abe1cab tempest-VolumesNegativeTest-164898872 tempest-VolumesNegativeTest-164898872-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/7a0a824d-655a-4eed-9f77-963b90c6ead3" status: 404 len: 109 microversion: 2.1 time: 0.197628 Sep 15 00:44:30.985612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 9/12] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:30 2022] GET /compute/v2.1/os-volumes/7a0a824d-655a-4eed-9f77-963b90c6ead3 => generated 109 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:44:30.987387 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-40b785a4-a772-4de2-9962-edcbd9c47813 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/de1ecff3-10ce-49c2-b48b-64e4ef8aca6f" status: 200 len: 351 microversion: 2.1 time: 0.253304 Sep 15 00:44:30.987387 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 4/13] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:30 2022] GET /compute/v2.1/os-volumes/de1ecff3-10ce-49c2-b48b-64e4ef8aca6f => generated 351 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:31.379888 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-15d34642-1f95-48a8-8e89-1f0647bc1541 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Calling method '.version_select at 0x7f2f1dd63670>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:31.548729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-15d34642-1f95-48a8-8e89-1f0647bc1541 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c" status: 200 len: 353 microversion: 2.1 time: 0.175222 Sep 15 00:44:31.549410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 10/14] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:31 2022] GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:31.568114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ebe425da-8e86-4d71-9823-5ddf22e5d831 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Calling method '.version_select at 0x7f2f1ddf6ca0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:31.682601 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ebe425da-8e86-4d71-9823-5ddf22e5d831 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c" status: 200 len: 353 microversion: 2.1 time: 0.122106 Sep 15 00:44:31.685979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 5/15] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:31 2022] GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:31.711970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-52f11144-3e48-4c5c-9dfe-112773d76f27 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Calling method '.version_select at 0x7f2f1dd63ee0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:31.714527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0df223fa-6445-46c5-a6ba-f1a051a0d30b tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1de07310>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:31.817739 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0df223fa-6445-46c5-a6ba-f1a051a0d30b tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209" status: 200 len: 344 microversion: 2.1 time: 0.114049 Sep 15 00:44:31.818724 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 6/16] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:31 2022] GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:31.834241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-983ae896-63bc-4a94-88c1-235bf6088ad8 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Action: 'create', calling method: .version_select at 0x7f2f1de07820>, body: {"snapshot": {"volume_id": "328521d2-9b8b-4532-b4e3-7a15c90d9209", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-655418031"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:31.869460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-52f11144-3e48-4c5c-9dfe-112773d76f27 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c" status: 202 len: 0 microversion: 2.1 time: 0.169001 Sep 15 00:44:31.870052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 11/17] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:44:31 2022] DELETE /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:44:31.878200 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-dcb15e75-f30a-4c55-ac77-6847e0945155 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Calling method '.version_select at 0x7f2f1dd635e0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:31.986404 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-dcb15e75-f30a-4c55-ac77-6847e0945155 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c" status: 200 len: 352 microversion: 2.1 time: 0.112032 Sep 15 00:44:31.987160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 12/18] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:31 2022] GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:44:32.204557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-983ae896-63bc-4a94-88c1-235bf6088ad8 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.376449 Sep 15 00:44:32.205141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 7/19] 10.222.0.15 () {60 vars in 1162 bytes} [Thu Sep 15 00:44:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:44:32.217501 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e975d282-cdfd-4d65-871d-e8e87e6b35b9 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1df66dc0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:32.287837 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e975d282-cdfd-4d65-871d-e8e87e6b35b9 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 286 microversion: 2.1 time: 0.074281 Sep 15 00:44:32.289678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 13/20] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:32 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:32.299513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b2bdaf79-1ef1-429c-a820-337a2498fa80 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1ddf6700>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:32.380871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b2bdaf79-1ef1-429c-a820-337a2498fa80 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.085292 Sep 15 00:44:32.381691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 8/21] 10.222.0.15 () {58 vars in 1140 bytes} [Thu Sep 15 00:44:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:32.394994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9731c509-e262-4da6-882d-bb18f916fdde tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1ddcf040>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:32.492803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9731c509-e262-4da6-882d-bb18f916fdde tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 286 microversion: 2.1 time: 0.103227 Sep 15 00:44:32.493079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 14/22] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:32 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:32.570549 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-295a96ca-df6d-4dee-9829-b2cd16b03fc6 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1de071f0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:32.639184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-295a96ca-df6d-4dee-9829-b2cd16b03fc6 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e43b388f-e9cd-467c-89bb-5cb57884f879" status: 200 len: 351 microversion: 2.1 time: 0.072523 Sep 15 00:44:32.639781 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 9/23] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:32 2022] GET /compute/v2.1/os-volumes/e43b388f-e9cd-467c-89bb-5cb57884f879 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:33.005172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4c1983f7-4733-47b4-a1cc-6e1f81eddbe9 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Calling method '.version_select at 0x7f2f1de3b1f0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:33.114574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-4c1983f7-4733-47b4-a1cc-6e1f81eddbe9 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] HTTP exception thrown: Volume 45ef29be-be79-45a6-a1b3-e935241f869c could not be found. Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4c1983f7-4733-47b4-a1cc-6e1f81eddbe9 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Request method failure captured: Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c HTTP/1.1 Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInVr6VZgpQ0vL6p1oabMy2zNFLc8PmEW3eWMvuOpOBZlwxE0dg3GSZcn4JpOgqQa122BgsWJAhnj0o5gvHvi5hPj6xT3NJOzBkHVEklxFUsriagfajS_cniot5XWGmxahIFlphtQLtnI2qsXpQPWD9Jf31rWnrBVi2FGkelklkhZwO8 Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: d0742191cd4d45d0a67eaf82b377e2c3 Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesGetTestJSON-2141931581 Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:44:33.116640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0742191cd4d45d0a67eaf82b377e2c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0742191cd4d45d0a67eaf82b377e2c3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0742191cd4d45d0a67eaf82b377e2c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0742191cd4d45d0a67eaf82b377e2c3"}]}] Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesGetTestJSON-2141931581 Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: d0742191cd4d45d0a67eaf82b377e2c3 Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesGetTestJSON-2141931581 Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesGetTestJSON-2141931581-project Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 38af5c5ada9644f59dd85ed674828f37 Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesGetTestJSON-2141931581-project Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Volume 45ef29be-be79-45a6-a1b3-e935241f869c could not be found. Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '45ef29be-be79-45a6-a1b3-e935241f869c'} Sep 15 00:44:33.117756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45ef29be-be79-45a6-a1b3-e935241f869c could not be found. (HTTP 404) (Request-ID: req-f5725d29-0c56-481b-860b-0051ad919e4e) Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:33.118379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:33.119227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45ef29be-be79-45a6-a1b3-e935241f869c could not be found. Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 00:44:33.120139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45ef29be-be79-45a6-a1b3-e935241f869c could not be found. Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45ef29be-be79-45a6-a1b3-e935241f869c could not be found. Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4c1983f7-4733-47b4-a1cc-6e1f81eddbe9 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] Returning 404 to user: Volume 45ef29be-be79-45a6-a1b3-e935241f869c could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4c1983f7-4733-47b4-a1cc-6e1f81eddbe9 tempest-VolumesGetTestJSON-2141931581 tempest-VolumesGetTestJSON-2141931581-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c" status: 404 len: 109 microversion: 2.1 time: 0.120743 Sep 15 00:44:33.121161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 15/24] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:32 2022] GET /compute/v2.1/os-volumes/45ef29be-be79-45a6-a1b3-e935241f869c => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:44:33.507050 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-79dc6e90-1c4f-489e-9247-63f37d356920 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dd963a0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:33.591891 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-79dc6e90-1c4f-489e-9247-63f37d356920 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 286 microversion: 2.1 time: 0.089093 Sep 15 00:44:33.592731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 10/25] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:33 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:34.605381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-58f76fa5-fe21-4730-843b-9eb66a430700 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dd63430>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:34.682209 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-58f76fa5-fe21-4730-843b-9eb66a430700 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 286 microversion: 2.1 time: 0.081326 Sep 15 00:44:34.682776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 16/26] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:34 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:35.695901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a30bc294-0c0d-4d33-ab20-6047ccc954dd tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1de07280>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:35.757473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a30bc294-0c0d-4d33-ab20-6047ccc954dd tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 286 microversion: 2.1 time: 0.065846 Sep 15 00:44:35.758577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 11/27] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:35 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:36.772206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a95aa9d6-7e35-4e3a-b0df-c10b2c48527d tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1de3b820>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:36.842147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a95aa9d6-7e35-4e3a-b0df-c10b2c48527d tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 286 microversion: 2.1 time: 0.075596 Sep 15 00:44:36.842618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 17/28] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:36 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:37.857559 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-670d19f5-b384-4c33-a1c6-2b3d12b950c7 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dd63ca0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:38.151358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-670d19f5-b384-4c33-a1c6-2b3d12b950c7 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 286 microversion: 2.1 time: 0.300849 Sep 15 00:44:38.152209 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 18/29] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:37 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 286 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:38.424973 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f2036f48-8bba-4360-9d24-3c29964c56a2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'create', calling method: .version_select at 0x7f2f1de07a60>, body: {"keypair": {"name": "tempest-keypair-784784382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+1oXD/KyehSivyzdKhsBnw9XS0BxdoVEcbhaUn8aoM51EfvQKxLEYXaWrK18YCgcoFpEIck8mfpbgqJKAeCbjrnMR/hjb2jQkgaha0r7QL0MzeGmzk4K/DU8uhGf6VEQ=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:38.618424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-f2036f48-8bba-4360-9d24-3c29964c56a2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Getting quotas for project 6a9d9cf3606845ec964dd8320126293e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:44:38.632906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-f2036f48-8bba-4360-9d24-3c29964c56a2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Getting quotas for user c5307118357e44ffbff5074ae4a94c9d and project 6a9d9cf3606845ec964dd8320126293e. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:44:38.694047 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f2036f48-8bba-4360-9d24-3c29964c56a2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.870338 Sep 15 00:44:38.695436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 12/30] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:44:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:39.165376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3116408a-f0a3-41b8-855f-f2478d6c04e4 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dd63820>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:39.322011 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3116408a-f0a3-41b8-855f-f2478d6c04e4 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 287 microversion: 2.1 time: 0.160960 Sep 15 00:44:39.329747 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 19/31] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:39 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:39.334721 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-664ce7b9-ebdd-452a-ac0c-196779eaeaa2 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dd65820>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:39.588485 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-664ce7b9-ebdd-452a-ac0c-196779eaeaa2 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 202 len: 0 microversion: 2.1 time: 0.257147 Sep 15 00:44:39.590723 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 13/32] 10.222.0.15 () {58 vars in 1254 bytes} [Thu Sep 15 00:44:39 2022] DELETE /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:44:39.601682 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-61a43340-975b-4031-8201-104f0303a0d4 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dd69160>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:39.744086 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-61a43340-975b-4031-8201-104f0303a0d4 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 200 len: 286 microversion: 2.1 time: 0.147451 Sep 15 00:44:39.745364 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 20/33] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:39 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:40.334809 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-77223faf-1848-4bdf-9d23-b9fb15aaf1fd tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1dd1a550>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:40.578500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-77223faf-1848-4bdf-9d23-b9fb15aaf1fd tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2b80bc86-999b-476d-8023-c3848f07c684" status: 200 len: 350 microversion: 2.1 time: 0.247409 Sep 15 00:44:40.579071 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 14/34] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:40 2022] GET /compute/v2.1/os-volumes/2b80bc86-999b-476d-8023-c3848f07c684 => generated 350 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:40.595705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5b7f457e-ea33-45f4-9d4b-7ac772e7b4e4 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1dd63790>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:40.758169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4c0d3d94-e800-4890-a15d-d4b13c8f8cbb tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dd1aca0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:40.864143 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5b7f457e-ea33-45f4-9d4b-7ac772e7b4e4 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.274573 Sep 15 00:44:40.864898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 21/35] 10.222.0.15 () {58 vars in 1134 bytes} [Thu Sep 15 00:44:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:40.884239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1472368d-e8e2-4ea7-81cd-a5a0c500655f tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1ddcfa60>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:40.927444 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-4c0d3d94-e800-4890-a15d-d4b13c8f8cbb tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] HTTP exception thrown: Snapshot faa84970-66bc-449e-83f9-db08c94534bb could not be found. Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4c0d3d94-e800-4890-a15d-d4b13c8f8cbb tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Request method failure captured: Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb HTTP/1.1 Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInVrOwsutns1_4mJb7Z63Gh31EQWuq_lNtFX0Nva8gckZ5FZ5RQq9I8ULESoPnCfBa9O6pSakoGjB4tKoAK4X7a-jHKgEKXULCfpX9ciWMq4wPxzaD_WYK6lOM8hHzSFchkJrPPTaiNvCUo8SZIyO6cbAsMeWxsoTLIob-nFFTDf9Eo Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: b77ee72d79e048be9cb68bf296ec6bec Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:44:40.931172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b77ee72d79e048be9cb68bf296ec6bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b77ee72d79e048be9cb68bf296ec6bec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b77ee72d79e048be9cb68bf296ec6bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b77ee72d79e048be9cb68bf296ec6bec"}]}] Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: b77ee72d79e048be9cb68bf296ec6bec Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesSnapshotsTestJSON-1206227688-project Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 5cf5ef2e256f426ca72574e40caf1ecd Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1206227688-project Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Snapshot faa84970-66bc-449e-83f9-db08c94534bb could not be found. Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'faa84970-66bc-449e-83f9-db08c94534bb'} Sep 15 00:44:40.932332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot faa84970-66bc-449e-83f9-db08c94534bb could not be found. (HTTP 404) (Request-ID: req-85636815-227e-492d-ba12-b9bdaff7cddb) Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:40.932954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:40.933782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot faa84970-66bc-449e-83f9-db08c94534bb could not be found. Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 15 00:44:40.934750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot faa84970-66bc-449e-83f9-db08c94534bb could not be found. Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot faa84970-66bc-449e-83f9-db08c94534bb could not be found. Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4c0d3d94-e800-4890-a15d-d4b13c8f8cbb tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Returning 404 to user: Snapshot faa84970-66bc-449e-83f9-db08c94534bb could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:40.936503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4c0d3d94-e800-4890-a15d-d4b13c8f8cbb tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb" status: 404 len: 111 microversion: 2.1 time: 0.179624 Sep 15 00:44:40.937961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 15/36] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:44:40 2022] GET /compute/v2.1/os-snapshots/faa84970-66bc-449e-83f9-db08c94534bb => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:44:40.941732 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6720c22d-6dbc-46b7-9425-98c5452ce8e8 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dcef310>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:41.237206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1472368d-e8e2-4ea7-81cd-a5a0c500655f tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.357448 Sep 15 00:44:41.237778 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 22/37] 10.222.0.15 () {58 vars in 1149 bytes} [Thu Sep 15 00:44:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:44:41.253640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a146f5b4-a6f3-4cc9-b0bd-427dea103f14 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1dd6b0d0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:41.412478 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6720c22d-6dbc-46b7-9425-98c5452ce8e8 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209" status: 202 len: 0 microversion: 2.1 time: 0.472440 Sep 15 00:44:41.413988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 16/38] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:44:40 2022] DELETE /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:44:41.425389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c5520431-6f09-4fe8-9248-815dadb7a3c7 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dcef940>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:41.845196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a146f5b4-a6f3-4cc9-b0bd-427dea103f14 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.595772 Sep 15 00:44:41.854305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 23/39] 10.222.0.15 () {58 vars in 1134 bytes} [Thu Sep 15 00:44:41 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:44:41.854533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-c5520431-6f09-4fe8-9248-815dadb7a3c7 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] HTTP exception thrown: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:41.858843 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-efd0faad-d117-4841-a05c-e73ef17017f5 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1dd693a0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c5520431-6f09-4fe8-9248-815dadb7a3c7 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Request method failure captured: Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 HTTP/1.1 Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInVrOwsutns1_4mJb7Z63Gh31EQWuq_lNtFX0Nva8gckZ5FZ5RQq9I8ULESoPnCfBa9O6pSakoGjB4tKoAK4X7a-jHKgEKXULCfpX9ciWMq4wPxzaD_WYK6lOM8hHzSFchkJrPPTaiNvCUo8SZIyO6cbAsMeWxsoTLIob-nFFTDf9Eo Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: b77ee72d79e048be9cb68bf296ec6bec Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:44:41.859655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b77ee72d79e048be9cb68bf296ec6bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b77ee72d79e048be9cb68bf296ec6bec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b77ee72d79e048be9cb68bf296ec6bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b77ee72d79e048be9cb68bf296ec6bec"}]}] Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: b77ee72d79e048be9cb68bf296ec6bec Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesSnapshotsTestJSON-1206227688-project Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 5cf5ef2e256f426ca72574e40caf1ecd Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1206227688-project Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '328521d2-9b8b-4532-b4e3-7a15c90d9209'} Sep 15 00:44:41.861135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. (HTTP 404) (Request-ID: req-e7a9f659-89f3-4920-869d-e073f8be3d29) Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:41.862522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:41.863408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 00:44:41.873282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c5520431-6f09-4fe8-9248-815dadb7a3c7 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Returning 404 to user: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c5520431-6f09-4fe8-9248-815dadb7a3c7 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209" status: 404 len: 109 microversion: 2.1 time: 0.442850 Sep 15 00:44:41.875570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 17/40] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:41 2022] GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 => generated 109 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:44:41.891506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a0f6e6e3-ca9e-40f2-afea-7a2041212d52 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dcef8b0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:42.207668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-a0f6e6e3-ca9e-40f2-afea-7a2041212d52 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] HTTP exception thrown: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a0f6e6e3-ca9e-40f2-afea-7a2041212d52 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Request method failure captured: Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 HTTP/1.1 Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInVrOwsutns1_4mJb7Z63Gh31EQWuq_lNtFX0Nva8gckZ5FZ5RQq9I8ULESoPnCfBa9O6pSakoGjB4tKoAK4X7a-jHKgEKXULCfpX9ciWMq4wPxzaD_WYK6lOM8hHzSFchkJrPPTaiNvCUo8SZIyO6cbAsMeWxsoTLIob-nFFTDf9Eo Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: b77ee72d79e048be9cb68bf296ec6bec Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:44:42.209641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b77ee72d79e048be9cb68bf296ec6bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b77ee72d79e048be9cb68bf296ec6bec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b77ee72d79e048be9cb68bf296ec6bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b77ee72d79e048be9cb68bf296ec6bec"}]}] Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: b77ee72d79e048be9cb68bf296ec6bec Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesSnapshotsTestJSON-1206227688-project Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 5cf5ef2e256f426ca72574e40caf1ecd Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1206227688-project Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '328521d2-9b8b-4532-b4e3-7a15c90d9209'} Sep 15 00:44:42.210659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. (HTTP 404) (Request-ID: req-f60b3825-3f46-4a08-b63c-dc2f8b45545c) Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:42.211291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 00:44:42.212242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 00:44:42.213116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a0f6e6e3-ca9e-40f2-afea-7a2041212d52 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Returning 404 to user: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a0f6e6e3-ca9e-40f2-afea-7a2041212d52 tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209" status: 404 len: 109 microversion: 2.1 time: 0.337161 Sep 15 00:44:42.214063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 18/41] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:44:41 2022] DELETE /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 => generated 109 bytes in 338 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:44:42.378321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-efd0faad-d117-4841-a05c-e73ef17017f5 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.522878 Sep 15 00:44:42.379608 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 24/42] 10.222.0.15 () {58 vars in 1167 bytes} [Thu Sep 15 00:44:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:42.396052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ccb4bf57-0f9f-4400-b249-f0c0000bac9d tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Calling method '.version_select at 0x7f2f1dd63310>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:42.454114 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-ccb4bf57-0f9f-4400-b249-f0c0000bac9d tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] HTTP exception thrown: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ccb4bf57-0f9f-4400-b249-f0c0000bac9d tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Request method failure captured: Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 HTTP/1.1 Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInVrOwsutns1_4mJb7Z63Gh31EQWuq_lNtFX0Nva8gckZ5FZ5RQq9I8ULESoPnCfBa9O6pSakoGjB4tKoAK4X7a-jHKgEKXULCfpX9ciWMq4wPxzaD_WYK6lOM8hHzSFchkJrPPTaiNvCUo8SZIyO6cbAsMeWxsoTLIob-nFFTDf9Eo Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: b77ee72d79e048be9cb68bf296ec6bec Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:44:42.456680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b77ee72d79e048be9cb68bf296ec6bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b77ee72d79e048be9cb68bf296ec6bec", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b77ee72d79e048be9cb68bf296ec6bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b77ee72d79e048be9cb68bf296ec6bec"}]}] Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: b77ee72d79e048be9cb68bf296ec6bec Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1206227688 Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesSnapshotsTestJSON-1206227688-project Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 5cf5ef2e256f426ca72574e40caf1ecd Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1206227688-project Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '328521d2-9b8b-4532-b4e3-7a15c90d9209'} Sep 15 00:44:42.457752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. (HTTP 404) (Request-ID: req-ab756710-4485-494b-8d33-24af8cfc98b7) Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:42.458401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 00:44:42.459366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 00:44:42.460304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ccb4bf57-0f9f-4400-b249-f0c0000bac9d tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] Returning 404 to user: Volume 328521d2-9b8b-4532-b4e3-7a15c90d9209 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ccb4bf57-0f9f-4400-b249-f0c0000bac9d tempest-VolumesSnapshotsTestJSON-1206227688 tempest-VolumesSnapshotsTestJSON-1206227688-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209" status: 404 len: 109 microversion: 2.1 time: 0.076317 Sep 15 00:44:42.461183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 25/43] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 15 00:44:42 2022] GET /compute/v2.1/os-volumes/328521d2-9b8b-4532-b4e3-7a15c90d9209 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:44:42.465549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-21d70d7c-59cc-4196-9ab9-92e5c1069f1f tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1de3b820>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:42.537932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1417615741", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:42.660914 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-21d70d7c-59cc-4196-9ab9-92e5c1069f1f tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.201300 Sep 15 00:44:42.661965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 26/44] 10.222.0.15 () {58 vars in 1170 bytes} [Thu Sep 15 00:44:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:42.678338 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-96378186", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c24ea2a-0e34-4fdb-be58-bbcdcac71ac0"}], "security_groups": [{"name": "tempest-securitygroup--1746867613"}], "key_name": "tempest-keypair-784784382", "user_data": "}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:42.739415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] validate_networks() for [('534fcea4-462b-402d-9da6-e7cef4200229', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:44:42.937266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] validate_networks() for [('5c24ea2a-0e34-4fdb-be58-bbcdcac71ac0', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:44:44.272440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:44:44.273623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:44:44.274253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:44:44.274841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:44:44.275405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:44:44.298211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:44.300989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:44.301605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:44.304044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:44.305339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:44.307304 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:44.463313 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Getting quotas for project 7090f91f78534107ba4b5ccd7f80e145. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:44:44.484504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Getting quotas for user 4e0e6a33679f4cac96704f71dcfa5c01 and project 7090f91f78534107ba4b5ccd7f80e145. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:44:44.523840 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:44:44.527603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:44:44.563140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:44:44.567930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:44:44.568601 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:44:44.569130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:44:44.570236 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:44:44.616748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:44.617421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:44.619045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:44.619977 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:44.624877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:44.628104 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:44.682892 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d7da2bc8-a2f9-4e6d-8df9-07191e34e5ba tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.469682 Sep 15 00:44:44.683860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 19/45] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:44:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:44:44.693222 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Getting quotas for project 6a9d9cf3606845ec964dd8320126293e. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:44:44.702979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Getting quotas for user c5307118357e44ffbff5074ae4a94c9d and project 6a9d9cf3606845ec964dd8320126293e. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:44:44.713086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4b90dbb1-8449-4ad0-b3a3-9fca34291d9a tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1dc78c10>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:44.728029 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:44:44.731381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:44:44.887624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4b90dbb1-8449-4ad0-b3a3-9fca34291d9a tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.201104 Sep 15 00:44:44.890403 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 20/46] 10.222.0.15 () {58 vars in 1155 bytes} [Thu Sep 15 00:44:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:44.914497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b6a9b144-00d1-4a1f-9da9-e55de964f4b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.251200 Sep 15 00:44:44.919282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 27/47] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:44:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:44:44.941045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fb1fff5f-3472-44df-8282-f5937cd193d2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:44.949748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fb1fff5f-3472-44df-8282-f5937cd193d2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:45.246975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fb1fff5f-3472-44df-8282-f5937cd193d2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:45.289968 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fb1fff5f-3472-44df-8282-f5937cd193d2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1222 microversion: 2.1 time: 0.364830 Sep 15 00:44:45.292744 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 28/48] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:44 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1222 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:45.312869 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9c6cc6c6-4662-400d-b567-5a128e71c3b6 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1d40f4c0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:45.423194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1726910735", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "networks": [{"uuid": "af1ef824-3295-4205-b148-29e927c60665"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:45.594945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] validate_networks() for [('af1ef824-3295-4205-b148-29e927c60665', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:44:45.655060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9c6cc6c6-4662-400d-b567-5a128e71c3b6 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.361066 Sep 15 00:44:45.664502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 29/49] 10.222.0.15 () {58 vars in 1188 bytes} [Thu Sep 15 00:44:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:44:45.664502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c050149e-ef0e-447a-955a-208e9e985377 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:45.664502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c050149e-ef0e-447a-955a-208e9e985377 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:45.790052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c050149e-ef0e-447a-955a-208e9e985377 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:45.806311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c050149e-ef0e-447a-955a-208e9e985377 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1235 microversion: 2.1 time: 0.149043 Sep 15 00:44:45.806902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 30/50] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:45 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1235 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:45.826641 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b1e7d6f2-a5cc-49a9-914a-33c33e43bf42 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] Calling method '.version_select at 0x7f2f1d479280>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:45.962602 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b1e7d6f2-a5cc-49a9-914a-33c33e43bf42 tempest-VolumesTestJSON-1108571040 tempest-VolumesTestJSON-1108571040-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.149159 Sep 15 00:44:45.963178 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 31/51] 10.222.0.15 () {58 vars in 1155 bytes} [Thu Sep 15 00:44:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:45.969037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1095868366", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:46.116082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] validate_networks() for [('534fcea4-462b-402d-9da6-e7cef4200229', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:44:46.508323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:44:46.509287 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:44:46.509944 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:44:46.510497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:44:46.511045 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:44:46.541821 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:46.548399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:46.550151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:46.553170 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:46.555320 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:46.559423 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:46.616814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Getting quotas for project bc126ea1c77342d091a96baf33bedf6e. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:44:46.629483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Getting quotas for user 33070b58c99741eeb9f97a73507d012e and project bc126ea1c77342d091a96baf33bedf6e. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:44:46.656772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:44:46.659759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:44:46.794333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-68fdba3b-6d3c-4215-a719-4afd554b2e1e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.902651 Sep 15 00:44:46.803367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 21/52] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:44:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:44:46.824266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-80b71b78-9c62-45c9-b0a0-c4323c43eb30 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:46.825003 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-80b71b78-9c62-45c9-b0a0-c4323c43eb30 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:47.095719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-80b71b78-9c62-45c9-b0a0-c4323c43eb30 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:47.132994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-80b71b78-9c62-45c9-b0a0-c4323c43eb30 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1215 microversion: 2.1 time: 0.328149 Sep 15 00:44:47.133591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 22/53] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:46 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:47.151871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f160d8b5-aa1b-41c8-b5ba-01a0ee433261 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:47.152517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f160d8b5-aa1b-41c8-b5ba-01a0ee433261 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:47.494308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f160d8b5-aa1b-41c8-b5ba-01a0ee433261 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:47.501830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f160d8b5-aa1b-41c8-b5ba-01a0ee433261 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1235 microversion: 2.1 time: 0.365854 Sep 15 00:44:47.502450 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 23/54] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:47 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1235 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:47.621470 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:44:47.622010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:44:47.622376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:44:47.622796 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:44:47.624001 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:44:47.635686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:47.636190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:47.636638 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:47.637382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:47.637848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:47.638279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:47.699884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Getting quotas for project 7090f91f78534107ba4b5ccd7f80e145. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:44:47.708162 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Getting quotas for user 4e0e6a33679f4cac96704f71dcfa5c01 and project 7090f91f78534107ba4b5ccd7f80e145. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:44:47.738223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:44:47.744471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:44:47.849532 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c74c890c-8b91-467e-b9c5-64e57bece0c7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.884929 Sep 15 00:44:47.852923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 32/55] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:44:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:44:47.864852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2148fc7a-c8bc-4ec6-b4fd-8f5ff851b85d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:47.866176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2148fc7a-c8bc-4ec6-b4fd-8f5ff851b85d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:48.047518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2148fc7a-c8bc-4ec6-b4fd-8f5ff851b85d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:48.068044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2148fc7a-c8bc-4ec6-b4fd-8f5ff851b85d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1222 microversion: 2.1 time: 0.200881 Sep 15 00:44:48.073466 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 24/56] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:47 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1222 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:48.159471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:48.160145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:48.176905 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:48.180698 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:48.183379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:48.184433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:48.187960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:48.190897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:48.526079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:48.526792 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:48.540218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:48.543405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:48.550571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:48.556074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:48.556869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:48.557798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:48.760497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:48.792678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-91c9b161-025c-4fb6-b4fd-6a483791fb44 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1211 microversion: 2.1 time: 0.635976 Sep 15 00:44:48.795076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 33/57] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:48 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1211 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:49.034549 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:49.062046 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ead26bbe-6695-4fec-b2d1-3fc61e752a7b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1231 microversion: 2.1 time: 0.539694 Sep 15 00:44:49.065459 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 25/58] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:48 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1231 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:44:49.114481 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b54082fd-900c-4b49-a01f-6f6e760144fa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:49.116248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b54082fd-900c-4b49-a01f-6f6e760144fa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:49.262026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b54082fd-900c-4b49-a01f-6f6e760144fa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:49.274927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b54082fd-900c-4b49-a01f-6f6e760144fa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1222 microversion: 2.1 time: 0.184273 Sep 15 00:44:49.279074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 34/59] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:49 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1222 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:49.819571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:49.820201 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:49.836263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:49.837239 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:49.839439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:49.841127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:49.844579 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:49.845271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:50.090079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:50.090756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:50.111223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:50.111980 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:50.112644 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:50.113603 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:50.114243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:50.115338 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:50.216007 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:50.226416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ac297596-0928-4651-8076-c344d53ddc12 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1231 microversion: 2.1 time: 0.140787 Sep 15 00:44:50.227358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 35/60] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:50 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1231 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:44:50.236429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:50.254036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7a21d8d8-67e9-4cc0-9bf7-ab1bb10cd144 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1267 microversion: 2.1 time: 0.438607 Sep 15 00:44:50.256354 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 26/61] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:49 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1267 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:44:50.301969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:50.302528 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:50.318260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:50.318846 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:50.319280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:50.328761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:50.331017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:50.340003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:50.967352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:50.976484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-405275cf-85bc-487c-b365-ea2a68ba2412 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1218 microversion: 2.1 time: 0.679466 Sep 15 00:44:50.996948 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 36/62] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:50 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1218 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:51.257125 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:51.259601 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:51.287547 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:51.288982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:51.301259 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:51.301853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:51.303118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:51.303282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:51.304148 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:51.304786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:51.306112 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:51.308171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:51.318803 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:51.320599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:51.326594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:51.328701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:51.555673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:51.584494 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-314b88b2-6175-4182-99e4-87cb927db0ed tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1273 microversion: 2.1 time: 0.302847 Sep 15 00:44:51.601886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 37/63] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:51 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:44:51.757028 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:51.776428 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-58edc0ef-ed68-46ef-a2f6-3d7e606c8119 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1287 microversion: 2.1 time: 0.527961 Sep 15 00:44:51.777194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 27/64] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:51 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1287 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:52.025219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:52.026014 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:52.037374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:52.039373 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:52.041231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:52.043534 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:52.046725 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:52.047379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:52.268716 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:52.277717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-708f07e8-2719-437a-bd71-8fb1ba65eef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1274 microversion: 2.1 time: 0.256813 Sep 15 00:44:52.282522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 38/65] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:52 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:52.615830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:52.618851 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:52.640193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:52.640715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:52.641215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:52.642021 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:52.648631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:52.651990 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:52.801070 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:52.802562 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:52.821244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:52.821925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:52.823681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:52.824549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:52.825184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:52.830161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:53.485545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:53.494938 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3d9a12da-e76d-475c-8a66-418a5148076b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1293 microversion: 2.1 time: 0.699426 Sep 15 00:44:53.504358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 39/66] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:52 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1293 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:53.509654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:53.519585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:53.530886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:53.533972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:53.537339 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:53.538289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:53.538879 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:53.539774 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:53.728412 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:53.740433 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a015b53f-2a45-4359-8d06-1d99d436aad9 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1273 microversion: 2.1 time: 1.129969 Sep 15 00:44:53.741159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 28/67] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:52 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1273 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:54.139817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:54.180165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fd07b841-1eee-415d-ac1c-c3d1881737d9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1280 microversion: 2.1 time: 0.674280 Sep 15 00:44:54.199536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 40/68] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:53 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1280 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:54.528216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:54.528830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:54.560725 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:54.563069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:54.563903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:54.570878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:54.573501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:54.574218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:54.773132 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:54.773751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:54.787675 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:54.788178 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:54.788617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:54.789332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:54.789791 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:54.790215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:55.116354 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:55.131999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-762a154f-245a-44d4-a7ef-841c17e5bfbc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1293 microversion: 2.1 time: 0.607641 Sep 15 00:44:55.143752 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 29/69] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:54 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1293 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:44:55.214500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:55.215191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:55.231831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:55.232536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:55.236262 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:55.240940 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:55.242657 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:55.243298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:55.694437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:55.710583 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-11a6b168-d10b-4a71-ae1a-2787402605f4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1280 microversion: 2.1 time: 0.500014 Sep 15 00:44:55.723712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 30/70] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:55 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1280 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:44:56.010514 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:56.022115 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-42bb5bc8-cb6a-48ba-b7ad-342465b14d78 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 1.253183 Sep 15 00:44:56.039972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 41/71] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:54 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:56.165568 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:56.166370 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:56.179827 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:56.180369 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:56.187857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:56.190758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:56.191288 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:56.191780 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:56.469229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:56.486878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-237612cc-d2c5-467d-a716-3b87058f0658 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1293 microversion: 2.1 time: 0.324390 Sep 15 00:44:56.496237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 31/72] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:56 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1293 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:56.740333 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:56.740528 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:56.752880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:56.755144 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:56.756833 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:56.759050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:56.760327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:56.760773 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:57.052707 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:57.053329 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:57.055651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=4 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:57.076029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:57.076614 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:57.077066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:57.080349 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:57.080833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:57.081364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:57.652597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=4 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:57.703369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:57.713161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d871968b-f23f-4a07-b8ec-fff3794f868c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.981180 Sep 15 00:44:57.728915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 42/73] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:56 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:57.740165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:57.741118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:57.770412 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:57.773707 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:57.774159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:57.774908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:57.775368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:57.778179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:58.053839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=22 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:58.539027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:58.598519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e4c9efb6-a722-414f-a7e8-1ccfa829b736 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 1.549597 Sep 15 00:44:58.600244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 32/74] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:57 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:58.744218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:58.745051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:58.756692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:58.758218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:58.760550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:58.762293 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:58.764688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:58.765339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:59.002027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:59.034442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-60736630-8902-40b3-b4da-05170d5756d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 1.303498 Sep 15 00:44:59.037275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 43/75] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:57 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:44:59.290590 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:44:59.308497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c591994c-3d3c-459b-9aa1-08e3386f2e94 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.566831 Sep 15 00:44:59.311333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 33/76] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:58 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:44:59.338750 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=18 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:59.632785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:44:59.635083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:44:59.651774 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:59.653772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:59.654772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:59.658462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:59.659385 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:59.660359 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:59.785926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-2f481143-e990-48a4-83fa-8e3045e84783 req-cd9aeb16-9a18-4606-be52-d74f3cf7e516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db3aac8-68f8-4028-8905-acb495f6ab89", "tag": "60e67ba0-1a38-4c2c-8f3b-75d937cf69ec"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:44:59.826430 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-2f481143-e990-48a4-83fa-8e3045e84783 req-cd9aeb16-9a18-4606-be52-d74f3cf7e516 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:59.829166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-2f481143-e990-48a4-83fa-8e3045e84783 req-cd9aeb16-9a18-4606-be52-d74f3cf7e516 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:59.833508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-2f481143-e990-48a4-83fa-8e3045e84783 req-cd9aeb16-9a18-4606-be52-d74f3cf7e516 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:59.963848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-2f481143-e990-48a4-83fa-8e3045e84783 req-cd9aeb16-9a18-4606-be52-d74f3cf7e516 service nova] Creating event network-changed:60e67ba0-1a38-4c2c-8f3b-75d937cf69ec for instance 6db3aac8-68f8-4028-8905-acb495f6ab89 on hv-cinder-85752 Sep 15 00:44:59.963848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-2f481143-e990-48a4-83fa-8e3045e84783 req-cd9aeb16-9a18-4606-be52-d74f3cf7e516 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127200) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 00:44:59.963848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-2f481143-e990-48a4-83fa-8e3045e84783 req-cd9aeb16-9a18-4606-be52-d74f3cf7e516 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127200) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 00:44:59.963848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:59.963848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:59.964675 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:59.964675 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:44:59.964675 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:44:59.964675 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:44:59.982426 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.compute.rpcapi [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 00:44:59.986642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] Releasing lock "compute-rpcapi-router" {{(pid=127200) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 00:45:00.020074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0b7af88c-6261-4b31-98a0-c559b2232f75 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.692926 Sep 15 00:45:00.021405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 44/77] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:45:00.288747 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-b6df9ce9-4753-43d5-a2de-80681229a68f req-65268c80-9713-4549-ad06-4baf2aac8107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b40368c8-a515-46b7-add6-5db877d59406", "tag": "3231acc1-76a4-4c22-96c0-9edb4cf1f79e"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:00.304156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-b6df9ce9-4753-43d5-a2de-80681229a68f req-65268c80-9713-4549-ad06-4baf2aac8107 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:00.304745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-b6df9ce9-4753-43d5-a2de-80681229a68f req-65268c80-9713-4549-ad06-4baf2aac8107 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:00.305197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-b6df9ce9-4753-43d5-a2de-80681229a68f req-65268c80-9713-4549-ad06-4baf2aac8107 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:00.361799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-b6df9ce9-4753-43d5-a2de-80681229a68f req-65268c80-9713-4549-ad06-4baf2aac8107 service nova] Creating event network-changed:3231acc1-76a4-4c22-96c0-9edb4cf1f79e for instance b40368c8-a515-46b7-add6-5db877d59406 on hv-cinder-85752 Sep 15 00:45:00.378467 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-b6df9ce9-4753-43d5-a2de-80681229a68f req-65268c80-9713-4549-ad06-4baf2aac8107 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355470 Sep 15 00:45:00.383259 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 45/78] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:45:00.396554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:00.397282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:00.422198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:00.422712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:00.428251 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:00.429280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:00.431723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:00.432179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:00.651399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:00.663184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-824df1ca-d6c7-4648-809a-bd502ef7ee80 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 1.038396 Sep 15 00:45:00.679506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 34/79] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:44:59 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:00.679506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:00.679506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:00.696849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:00.701207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:00.701787 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:00.703975 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:00.709287 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:00.709932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:01.054633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:01.078433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d92dc150-eb17-412c-a6a7-d38e32f407b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.691905 Sep 15 00:45:01.079262 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 46/80] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:00 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:01.304974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:01.336865 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-59255260-160e-4708-81c3-1bf24a98b217 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.666134 Sep 15 00:45:01.340103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 35/81] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:00 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:01.694765 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:01.696055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:01.714616 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:01.717799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:01.719639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:01.723273 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:01.725897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:01.726461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:02.108715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:02.109986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:02.118511 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:02.121415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:02.122766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:02.124482 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:02.126355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:02.129428 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:02.135674 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:02.148793 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-bf7ce5da-aa0c-4c38-9a01-5b9e286b5d2b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.458316 Sep 15 00:45:02.149378 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 47/82] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:01 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:02.364995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:02.365898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:02.393128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:02.393686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:02.394161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:02.394899 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:02.395378 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:02.404358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:03.115364 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:03.130670 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fc905034-ba5f-47a5-8a48-15d41de8af3b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.770736 Sep 15 00:45:03.132068 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 48/83] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:02 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:03.144853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-af608f5c-6094-493d-88f4-b204c41c87e4 req-9d56adbf-7c52-4fc9-b74f-32eed0565e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3368c45f-e52e-42fd-8f8c-43e3aeb5aeef", "tag": "a181a6dc-2e9a-4e22-a218-adf5eb7e3779"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:03.165882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-af608f5c-6094-493d-88f4-b204c41c87e4 req-9d56adbf-7c52-4fc9-b74f-32eed0565e27 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:03.172142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-af608f5c-6094-493d-88f4-b204c41c87e4 req-9d56adbf-7c52-4fc9-b74f-32eed0565e27 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:03.172837 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-af608f5c-6094-493d-88f4-b204c41c87e4 req-9d56adbf-7c52-4fc9-b74f-32eed0565e27 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:03.198331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-af608f5c-6094-493d-88f4-b204c41c87e4 req-9d56adbf-7c52-4fc9-b74f-32eed0565e27 service nova] Creating event network-changed:a181a6dc-2e9a-4e22-a218-adf5eb7e3779 for instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef on hv-cinder-85752 Sep 15 00:45:03.212801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-af608f5c-6094-493d-88f4-b204c41c87e4 req-9d56adbf-7c52-4fc9-b74f-32eed0565e27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079349 Sep 15 00:45:03.214028 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 49/84] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:45:03.245229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-53e53fb4-56b5-428b-ac7f-8ba16c75b2ee req-39c4260d-2db9-45a5-b006-0134ee41f05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d301ea-7505-4d72-8061-827894477da0", "tag": "45e2672c-5f66-4187-b159-c6d3bb80d12b"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:03.275901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-53e53fb4-56b5-428b-ac7f-8ba16c75b2ee req-39c4260d-2db9-45a5-b006-0134ee41f05b service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:03.276396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-53e53fb4-56b5-428b-ac7f-8ba16c75b2ee req-39c4260d-2db9-45a5-b006-0134ee41f05b service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:03.278473 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-53e53fb4-56b5-428b-ac7f-8ba16c75b2ee req-39c4260d-2db9-45a5-b006-0134ee41f05b service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:03.307471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-53e53fb4-56b5-428b-ac7f-8ba16c75b2ee req-39c4260d-2db9-45a5-b006-0134ee41f05b service nova] Creating event network-changed:45e2672c-5f66-4187-b159-c6d3bb80d12b for instance c1d301ea-7505-4d72-8061-827894477da0 on hv-cinder-85752 Sep 15 00:45:03.325324 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-53e53fb4-56b5-428b-ac7f-8ba16c75b2ee req-39c4260d-2db9-45a5-b006-0134ee41f05b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109564 Sep 15 00:45:03.326355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 50/85] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:45:03.338030 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:03.338823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:03.377729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:03.378188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:03.378636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:03.386396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:03.387081 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:03.387766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:03.427109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:03.447738 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aa8e44bf-4247-4c72-b2b8-c85574951f48 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 1.344129 Sep 15 00:45:03.450388 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 36/86] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:02 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:04.093283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:04.105233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4d2e3c6f-9162-477b-a342-fcd113752592 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.777325 Sep 15 00:45:04.105924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 51/87] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:03 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:04.158178 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:04.158800 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:04.177444 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:04.178008 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:04.178453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:04.179242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:04.179738 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:04.180224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:04.482849 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:04.483738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:04.513716 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:04.514502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:04.516540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:04.519092 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:04.521413 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:04.522040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:04.527034 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:04.978451 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:04.994587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4828940c-309f-40f1-a56e-b2e49141eb0f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.838840 Sep 15 00:45:05.000571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 37/88] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:04 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:05.041982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:05.078935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a66daa00-c5d4-4de4-8b03-93391e5fb8fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.607058 Sep 15 00:45:05.091567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 52/89] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:04 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:05.131730 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:05.132794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:05.146570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:05.147371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:05.148113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:05.151389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:05.152458 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:05.153234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:05.776184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:05.788074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-84d91980-e399-4df5-81c4-1ef5e7148995 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.660708 Sep 15 00:45:05.791152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 38/90] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:05 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:06.024816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:06.025453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:06.033779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:06.034982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:06.036878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:06.039029 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:06.042081 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:06.043286 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:06.118089 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:06.118740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:06.133242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:06.133760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:06.134207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:06.137525 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:06.139522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:06.139522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:06.351965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:06.363065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-cb892e17-f817-4f6c-bed8-b94ea7bddad8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.343618 Sep 15 00:45:06.364169 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 53/91] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:06 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:06.580279 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:06.611107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7b8466c0-9741-48ed-961c-767898879114 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.497212 Sep 15 00:45:06.614820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 39/92] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:06 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:06.817545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:06.819396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:06.826767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:06.827968 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:06.828666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:06.830458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:06.831439 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:06.831964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:07.059032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:07.069784 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-69662728-4722-451a-be30-88a39a420b01 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.258448 Sep 15 00:45:07.071435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 54/93] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:06 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:07.386758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:07.388024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:07.394699 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:07.395395 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:07.396165 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:07.397206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:07.397810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:07.398417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:07.637897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:07.638836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:07.646878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:07.651334 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:07.652103 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:07.654885 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:07.659424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:07.660135 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:07.723841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:07.727180 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:07.736299 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-59f7a405-b035-41b8-9eca-7613b0225e5d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.352083 Sep 15 00:45:07.736897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 40/94] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:07 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:07.972987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:07.986448 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4d35bfd4-89d5-4acb-b4ca-4ef6b153e219 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.352556 Sep 15 00:45:07.987030 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 55/95] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:07 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:08.094425 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:08.095983 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:08.097971 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:08.114589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:08.115801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:08.117014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:08.120708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:08.121384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:08.122100 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:08.305266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:08.316490 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-33fd44d9-4ac4-440b-a0b7-bc302ff312ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.225981 Sep 15 00:45:08.334709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 41/96] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:08 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:08.763723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:08.764911 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:08.773677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:08.779147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:08.779680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:08.781230 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:08.784176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:08.785044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:08.785831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:09.008897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:09.009522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:09.027070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:09.027708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:09.028133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:09.028849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:09.029312 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:09.029740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:09.135301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:09.145166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-817f4516-a6ce-46d8-a2c8-6e57283fc915 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.386468 Sep 15 00:45:09.149326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 56/97] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:08 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:09.340992 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:09.341902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:09.354172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:09.354897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:09.357119 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:09.359733 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:09.361037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:09.361473 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:09.444382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:09.457978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-84e90ea2-e1c5-4e2d-9a82-b5c2b96bea75 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.453134 Sep 15 00:45:09.458915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 42/98] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:09 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:09.676333 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:09.699130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-99fda5d2-d9c6-4296-afe3-93dd28c9a6bd tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.363183 Sep 15 00:45:09.700019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 57/99] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:09 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:10.173432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:10.174763 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:10.181606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:10.182183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:10.183060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:10.184383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:10.185011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:10.185870 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:10.369997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:10.386934 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dd14ec23-fe7d-483a-bbe6-e0bb41710a42 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.217705 Sep 15 00:45:10.388056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 43/100] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:10 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:10.483088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:10.484663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:10.492618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:10.495814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:10.496533 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:10.497387 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:10.499172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:10.504413 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:10.505098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:10.700050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:10.708961 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6f44d409-660b-496b-9b73-fa3071b16600 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.231111 Sep 15 00:45:10.709536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 58/101] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:10 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:10.726321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:10.727026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:10.733081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:10.733651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:10.734158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:10.734922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:10.735716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:10.736336 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:11.018017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:11.028841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fef42c63-c91c-4e9b-b4e7-a39d47ef8361 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.306229 Sep 15 00:45:11.031976 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 44/102] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:10 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:11.412433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:11.413060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:11.419576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:11.420281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:11.420734 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:11.421587 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:11.422045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:11.422780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:11.621278 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:11.629592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-40f998a1-d28f-4e5d-8ed7-7383f9bfe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.221222 Sep 15 00:45:11.630575 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 59/103] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:11 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:11.734031 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:11.734949 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:11.756070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:11.756070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:11.756070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:11.756070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:11.756406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:11.756406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:11.926274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:11.938439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bf0a18b3-622d-4b84-9ceb-f048871b95e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.207236 Sep 15 00:45:11.939263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 45/104] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:11 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:12.055967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:12.057191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:12.070055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:12.071249 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:12.073233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:12.075773 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:12.076264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:12.076713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:12.295163 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:12.303522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-39f01115-e500-41cc-9d22-4b6551bcc0b2 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.252734 Sep 15 00:45:12.304610 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 60/105] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:12 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:12.654311 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:12.655206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:12.661973 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:12.662766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:12.663522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:12.664401 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:12.665081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:12.665656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:12.844002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:12.852697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dc3ef3e6-41d1-4aec-a96b-450dd8be6128 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.202068 Sep 15 00:45:12.853454 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 46/106] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:12 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:12.963169 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:12.964059 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:12.972614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:12.973399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:12.973947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:12.974761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:12.975412 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:12.976128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:13.143682 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:13.155309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9a5c696b-c245-4a30-839a-31b9a5d062db tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.195877 Sep 15 00:45:13.156848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 61/107] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:12 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:13.330746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:13.331907 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:13.341218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:13.341930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:13.342346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:13.343284 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:13.343951 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:13.345161 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:13.588118 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:13.600664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-011e59c4-a2a7-4db1-baa8-a5d94fbba228 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.275604 Sep 15 00:45:13.601462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 47/108] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:13 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:13.877104 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:13.877721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:13.884924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:13.885419 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:13.885861 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:13.886565 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:13.887027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:13.887454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:14.062845 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:14.073349 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-683ad3bc-2913-4a3a-8524-35187bb172ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.200945 Sep 15 00:45:14.074486 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 62/109] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:13 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:14.179775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:14.180241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:14.186635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:14.187504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:14.188087 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:14.189763 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:14.190226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:14.190653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:14.422266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:14.430930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1a4bb4c0-ba24-49fb-8686-7db12a4184b4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.255259 Sep 15 00:45:14.431619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 48/110] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:14 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:14.623927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:14.624614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:14.631528 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:14.632037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:14.632547 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:14.633325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:14.634015 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:14.634445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:14.775338 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:14.784140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-60c8b625-e4d6-4500-8461-7a9251d543ba tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.164054 Sep 15 00:45:14.784740 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 63/111] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:14 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:15.101879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:15.102478 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:15.109101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:15.109605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:15.110118 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:15.110866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:15.111595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:15.112338 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:15.241527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:15.249104 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8665e250-2b5a-4347-97aa-d7d83e6ed490 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.151242 Sep 15 00:45:15.249662 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 49/112] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:15 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:15.452879 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:15.453493 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:15.459910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:15.460398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:15.460839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:15.461534 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:15.461995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:15.462420 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:15.585090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:15.596541 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-04ec484e-48b1-468f-9430-bb4a35ca4f04 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.145676 Sep 15 00:45:15.597274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 64/113] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:15 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:15.807814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:15.808434 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:15.814841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:15.815327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:15.815807 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:15.816501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:15.816960 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:15.817394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:15.945256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:15.952941 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7b511489-f575-4312-b9a1-25444725a435 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.149133 Sep 15 00:45:15.953503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 50/114] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:15 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:16.272283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:16.272841 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:16.278761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:16.279247 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:16.279726 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:16.280422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:16.280880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:16.281310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:16.410142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:16.418221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1c550f0b-2944-43a4-b703-f0871e0b7df4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.149562 Sep 15 00:45:16.418794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 65/115] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:16 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:16.619221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:16.619864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:16.625718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:16.626238 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:16.626625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:16.627317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:16.627828 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:16.628251 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:16.757813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:16.766933 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c9daae8e-9142-4059-8ae8-c593240afbac tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.151463 Sep 15 00:45:16.767608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 51/116] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:16 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:16.976654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:16.977270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:16.983127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:16.983651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:16.984093 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:16.984785 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:16.985244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:16.985670 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:17.117624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:17.125376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2d47f7eb-83da-4764-8325-ee55b8333c47 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.152556 Sep 15 00:45:17.125941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 66/117] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:16 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:17.441992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:17.442633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:17.448573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:17.449091 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:17.449478 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:17.456038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:17.456038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:17.456038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:17.581604 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:17.590244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b037e179-3a42-4367-81ae-a7767e386c7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.152519 Sep 15 00:45:17.590817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 52/118] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:17 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:17.789550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:17.790163 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:17.796059 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:17.796547 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:17.796984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:17.798180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:17.798635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:17.799058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:17.955252 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:17.963026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f234403c-bdb7-4267-b99f-32df92d846b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.177469 Sep 15 00:45:17.975830 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 67/119] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:17 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:18.148655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:18.150019 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:18.158106 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:18.158844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:18.159331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:18.160128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:18.160653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:18.161146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:18.168236 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-325246255", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "networks": [{"uuid": "7963b74a-c6e4-436d-bf68-47024742fd78"}]}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:18.239993 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] validate_networks() for [('7963b74a-c6e4-436d-bf68-47024742fd78', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:45:18.322401 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:18.330176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-adcf2736-b409-4641-bc30-a4b86a8f3f0e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.185582 Sep 15 00:45:18.330843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 53/120] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:18 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:18.615383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:18.616258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:18.624026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:18.624633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:18.625208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:18.625997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:18.626904 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:18.627619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:18.735832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:45:18.736512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:45:18.737734 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:45:18.738411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:45:18.739443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:45:18.750341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:18.751927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:18.752605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:18.753639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:18.754329 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:18.755045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:18.779586 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Getting quotas for project 06a0252a4fba4f1ebfa9f25a2c6e39a4. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:45:18.784516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Getting quotas for user 5f294ab83780460f9679c7655c97a6e4 and project 06a0252a4fba4f1ebfa9f25a2c6e39a4. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:45:18.797640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:45:18.800646 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:45:18.859044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:18.870689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2864b707-d4b9-4c30-877c-cd243b8c8722 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.261060 Sep 15 00:45:18.871584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 54/121] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:18 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:18.902763 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-40211ba2-47e8-424e-aab6-4a38f4f5476f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738826 Sep 15 00:45:18.907154 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 68/122] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:45:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 00:45:18.919751 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2511c177-5b64-4e53-9283-c37fee9a9700 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:18.920334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2511c177-5b64-4e53-9283-c37fee9a9700 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:18.986179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:18.986869 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:19.003524 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:19.004037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:19.004479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:19.005196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:19.006068 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:19.010001 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:19.035174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2511c177-5b64-4e53-9283-c37fee9a9700 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:19.050392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2511c177-5b64-4e53-9283-c37fee9a9700 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1213 microversion: 2.1 time: 0.135915 Sep 15 00:45:19.051130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 55/123] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:18 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:19.065852 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:19.277674 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:19.289992 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4389e7fe-f4d1-40f8-9718-54e871371607 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.307824 Sep 15 00:45:19.291190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 69/124] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:18 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:19.356569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:19.357739 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:19.364745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:19.365464 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:19.366224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:19.367216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:19.367886 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:19.368771 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:19.529411 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:19.538650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bbe1bd8a-91e4-4085-b6b7-9d360db28cc5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.186780 Sep 15 00:45:19.539364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 56/125] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:19 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:19.895349 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:19.896043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:19.904878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:19.908203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:19.909606 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:19.910802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:19.911319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:19.911978 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:20.077576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:20.078352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:20.104191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:20.104700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:20.105138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:20.105853 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:20.106302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:20.110012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:20.177380 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:20.189923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a61fec45-a3a8-438e-9b54-946a093aa6bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.298903 Sep 15 00:45:20.207531 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 70/126] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:19 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:20.213624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:20.224107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-625513fd-2c18-4969-a15d-41571452647d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.153299 Sep 15 00:45:20.225568 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 57/127] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:20 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:20.312790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:20.313925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:20.320090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:20.320576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:20.321086 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:20.321686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:20.322279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:20.322722 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:20.476816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:20.485748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ee8e1289-79af-48be-be7c-e9dd9d9b8c10 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.176836 Sep 15 00:45:20.486323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 71/128] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:20 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:20.562378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:20.563588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:20.569691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:20.570183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:20.570620 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:20.571397 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:20.571894 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:20.572318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:20.602176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:20.743068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:20.751621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0558155b-7bb1-4ff9-8e4c-348914f0eae3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.192429 Sep 15 00:45:20.752181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 58/129] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:20 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:21.248057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:21.248677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:21.254756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:21.255243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:21.268951 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:21.269544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:21.278424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:21.279193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:21.279716 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:21.281224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:21.282211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:21.282787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:21.287351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:21.288225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:21.288921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:21.289388 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:21.369653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:21.377796 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-82a56e63-370c-44d2-9d07-ad44ea96b083 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.121071 Sep 15 00:45:21.378365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 59/130] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:21 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:21.448654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:21.456978 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3bd1a971-7e2c-4965-a6cb-9ab7ea4eb1d6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.212854 Sep 15 00:45:21.457551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 72/131] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:21 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:21.511299 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:21.512030 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:21.519398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:21.520235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:21.520979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:21.521871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:21.522767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:21.523450 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:21.687026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:21.694819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-78b5cc86-4eb2-47ba-b97d-f5f5409b043e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.187837 Sep 15 00:45:21.699676 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 60/132] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:21 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:21.776220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:21.776942 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:21.783219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:21.783777 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:21.784190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:21.784884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:21.785338 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:21.785757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:21.941160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:21.953261 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5c35e4a4-7794-492f-b923-cd994153f417 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.180944 Sep 15 00:45:21.954641 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 73/133] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:21 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:22.402135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:22.402743 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:22.409107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:22.409598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:22.410236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:22.410939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:22.411404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:22.411852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:22.479528 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:22.480158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:22.486433 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:22.487446 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:22.488504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:22.489269 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:22.490663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:22.491311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:22.492447 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:22.494287 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9288a0c6-ea00-47bc-a779-445a2a606907 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.095839 Sep 15 00:45:22.494922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 61/134] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:22 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:22.662415 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:22.670164 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b1c70c69-8fd4-428e-bef4-3798bed4e354 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.194255 Sep 15 00:45:22.670739 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 74/135] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:22 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:22.718197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:22.718794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:22.728761 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:22.729264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:22.729728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:22.730438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:22.730895 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:22.731321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:22.896390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:22.903114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3976b80d-5b49-4982-99bd-136a5f1f03e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.188951 Sep 15 00:45:22.915520 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 62/136] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:22 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:22.978095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:22.978946 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:22.986057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:22.986824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:22.987675 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:22.988394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:22.988858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:22.989287 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:23.202622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:23.216769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-56a3db35-0acb-4c8b-918b-9fb2f397265c tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.243497 Sep 15 00:45:23.218798 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 75/137] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:22 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:23.519132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:23.519896 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:23.532617 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:23.534766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:23.535767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:23.538155 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:23.540824 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:23.541435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:23.630323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:23.641375 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-84778a03-c8e6-48cd-96a0-8e3d31776adb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.127289 Sep 15 00:45:23.642234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 63/138] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:23 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:23.697976 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:23.700112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:23.709295 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:23.711739 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:23.712197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:23.715891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:23.716411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:23.718748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:23.916995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:23.927126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:23.928040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:23.938849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:23.940131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:23.940848 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:23.941322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0979082f-c606-4b92-927a-daa7e41e6457 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.246671 Sep 15 00:45:23.941666 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:23.941947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 76/139] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:23 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:23.942300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:23.942798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:24.150352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:24.159306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d6e9e6df-8289-4745-babf-63df5f246e93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.236991 Sep 15 00:45:24.175858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 64/140] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:23 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:24.244393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:24.245014 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:24.251503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:24.251996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:24.252436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:24.253222 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:24.253683 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:24.254165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:24.493136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:24.506514 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4adfcc8a-3157-499b-90d3-e505c221b98d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.266841 Sep 15 00:45:24.507086 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 77/141] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:24 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:24.665683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:24.666300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:24.673801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:24.674304 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:24.674742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:24.675450 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:24.675962 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:24.676388 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:24.793242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:24.811275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0b4c0ba6-eb95-4b70-9c6f-1c0ba4ba256e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.144408 Sep 15 00:45:24.812102 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 65/142] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:24 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:24.955322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-cb8b0c0e-6ae3-4033-beba-6442b6396d20 req-f8c33d5b-d947-4992-bbc7-697419d8b45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40368c8-a515-46b7-add6-5db877d59406", "name": "network-vif-plugged", "status": "completed", "tag": "3231acc1-76a4-4c22-96c0-9edb4cf1f79e"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:24.964629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:24.965248 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:24.967635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-cb8b0c0e-6ae3-4033-beba-6442b6396d20 req-f8c33d5b-d947-4992-bbc7-697419d8b45f service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:24.968330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-cb8b0c0e-6ae3-4033-beba-6442b6396d20 req-f8c33d5b-d947-4992-bbc7-697419d8b45f service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:24.971311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-cb8b0c0e-6ae3-4033-beba-6442b6396d20 req-f8c33d5b-d947-4992-bbc7-697419d8b45f service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:24.976826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:24.977566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:24.978175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:24.979028 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:24.980117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:24.984056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:24.996026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-cb8b0c0e-6ae3-4033-beba-6442b6396d20 req-f8c33d5b-d947-4992-bbc7-697419d8b45f service nova] Creating event network-vif-plugged:3231acc1-76a4-4c22-96c0-9edb4cf1f79e for instance b40368c8-a515-46b7-add6-5db877d59406 on hv-cinder-85752 Sep 15 00:45:25.007359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-cb8b0c0e-6ae3-4033-beba-6442b6396d20 req-f8c33d5b-d947-4992-bbc7-697419d8b45f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282392 Sep 15 00:45:25.011209 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 78/143] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:45:25.173018 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:25.182914 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a5b5b905-be58-4a2c-a01b-d435d05eadea tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.221998 Sep 15 00:45:25.184018 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 66/144] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:24 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:25.184953 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:25.185850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:25.206199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:25.208679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:25.209047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:25.209784 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:25.211213 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:25.211524 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:25.458190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:25.466467 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ad5b9eef-c2e9-4560-838e-490a29afdf14 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.286907 Sep 15 00:45:25.467208 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 79/145] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:25 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:25.530519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:25.531136 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:25.538449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:25.538941 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:25.539376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:25.540192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:25.541210 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:25.541957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:25.700120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:25.709643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-752a56ac-38b1-406a-b6c1-f9c405565a08 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.182871 Sep 15 00:45:25.710247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 67/146] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:25 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:25.846505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:25.847225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:25.853055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:25.853555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:25.853968 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:25.854666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:25.855112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:25.855558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:25.926167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:25.936866 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-621e117a-0c75-4d74-a016-4914cb16e4d4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.094584 Sep 15 00:45:25.937882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 80/147] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:25 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:26.211183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:26.213100 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:26.219858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:26.220716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:26.221159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:26.222782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:26.223259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:26.223728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:26.416197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:26.432211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6c81b3c7-5c6d-4ed6-90b3-36526d9ff6f6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.224955 Sep 15 00:45:26.434216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 68/148] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:26 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:26.491129 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:26.491758 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:26.503217 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:26.503756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:26.504206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:26.506931 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:26.510257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:26.510713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:26.733458 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:26.734356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:26.745139 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:26.745634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:26.746076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:26.749325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:26.751093 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:26.751599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:26.752041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:26.765664 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a2a72d92-03f2-4422-96e0-5a48b9b93a3c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.279106 Sep 15 00:45:26.768569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 81/149] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:26 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:26.959764 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:26.961528 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:26.962317 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:26.970175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-72b750b8-5a0c-4374-a9f5-6c8c132ee765 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.241069 Sep 15 00:45:26.970937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 69/150] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:26 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:26.971541 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:26.973358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:26.975301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:26.977955 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:26.980504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:26.981250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:27.058477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:27.070052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a0929539-82f2-416e-8f73-2deb69429513 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.111250 Sep 15 00:45:27.075752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 82/151] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:26 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:27.456719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:27.457409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:27.466044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:27.466574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:27.467046 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:27.467713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:27.468338 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:27.468765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:27.694026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:27.702930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a91797fc-1f49-45bc-be5f-42ee4bb938ac tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.249983 Sep 15 00:45:27.704834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 70/152] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:27 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:27.794865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:27.795721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:27.803521 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:27.804217 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:27.805145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:27.806304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:27.807037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:27.807636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:27.995012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:27.995800 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:28.003340 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:28.003867 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:28.004299 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:28.005103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:28.005907 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:28.006433 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:28.191582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:28.206444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-df539702-c90c-41cc-9843-78ad3d47c1de tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.415927 Sep 15 00:45:28.207980 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 83/153] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:27 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:28.214332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:28.215996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:28.224251 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:28.225011 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:28.225663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:28.226932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:28.227412 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:28.227890 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:28.305471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:28.315091 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c44a6476-b61e-494b-8db3-39b47269271a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.105844 Sep 15 00:45:28.316050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 84/154] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:28 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:28.379497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:28.388098 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0d32d948-a160-4c84-ae23-bba1f9a46112 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.398875 Sep 15 00:45:28.388759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 71/155] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:27 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:28.729228 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:28.729923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:28.738154 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:28.738649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:28.739088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:28.739821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:28.740279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:28.740970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:28.768488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:28.793089 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=6 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:28.893441 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:28.902265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a6e7ae34-a38b-479e-a2c4-6445d113fa5e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.179061 Sep 15 00:45:28.902863 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 85/156] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:28 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:29.231594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:29.232384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:29.239295 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:29.241273 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:29.241933 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:29.242410 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:29.243699 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:29.244286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:29.244902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:29.337939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:29.339201 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:29.350551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:29.351283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:29.353860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:29.355047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:29.356282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:29.358177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:29.420535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:29.432436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ae277d82-a297-41ec-96b2-0937538bc32c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.205438 Sep 15 00:45:29.443567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 72/157] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:29 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:29.443567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:29.443567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:29.447516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:29.447516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:29.447516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:29.447792 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:29.448182 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:29.448937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:29.477350 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:29.480941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:29.487727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-362b000b-0471-4d78-bd9d-837f1bab3ace tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.153520 Sep 15 00:45:29.488553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 86/158] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:29 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:29.610998 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:29.618555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-89ee8a9c-5899-4b89-80fa-c6fdc55a527a tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.184029 Sep 15 00:45:29.619306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 73/159] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:29 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:29.928710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:29.929537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:29.935701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:29.936197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:29.936855 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:29.938169 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:29.938646 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:29.939078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:30.082688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:30.090426 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e43e15f9-2faa-4e45-a655-2fea9e13debf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.166535 Sep 15 00:45:30.090992 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 87/160] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:29 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:30.461402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:30.462116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:30.479874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:30.479874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:30.479874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:30.479874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:30.480192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:30.480192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:30.512802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:30.513629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:30.528944 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:30.529459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:30.529907 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:30.530634 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:30.531097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:30.532451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:30.596976 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:30.604508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-19bed7cb-ceba-41b2-8025-62fdc1119226 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.095729 Sep 15 00:45:30.605076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 88/161] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:30 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:30.614528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:30.622244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5f027e38-b19e-498e-bdb3-ad627579b687 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.165766 Sep 15 00:45:30.622808 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 74/162] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:30 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:30.642518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:30.643133 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:30.649202 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:30.649625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:30.650055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:30.650746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:30.651197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:30.651651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:30.781171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:30.788710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-37ace403-f591-408f-a66a-8f36c7a6fe61 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.150508 Sep 15 00:45:30.789303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 89/163] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:30 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:31.113759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:31.114378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:31.120269 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:31.120756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:31.121195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:31.121889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:31.122348 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:31.122776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:31.127270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:31.252964 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:31.260784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-acc9c2a5-a468-483b-9953-e62c6b7ed302 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.151386 Sep 15 00:45:31.261341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 75/164] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:31 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:31.627015 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:31.627760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:31.633962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:31.634434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:31.634862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:31.635567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:31.636018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:31.636436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:31.645538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:31.646642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:31.652798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:31.653300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:31.653742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:31.654451 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:31.654918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:31.655350 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:31.702621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:31.710295 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4071356c-14f9-4038-a483-e9f67fb45f43 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.086997 Sep 15 00:45:31.710941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 90/165] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:31 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:31.780915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:31.788953 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5dacb1d4-c1c0-4f57-9cdc-d302022bb2b1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.147506 Sep 15 00:45:31.789523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 76/166] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:31 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:31.811124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:31.811781 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:31.817690 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:31.818182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:31.818621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:31.819318 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:31.819801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:31.820228 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:31.947301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:31.955385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-70630923-9e32-4934-9638-ad4993f65b1d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.148144 Sep 15 00:45:31.955981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 91/167] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:31 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:32.284126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:32.284988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:32.291863 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.292496 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.292922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:32.293695 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.294162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.294595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:32.446048 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:32.458355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5a8dea54-113c-4303-87ef-5b817feaf45c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.178920 Sep 15 00:45:32.459413 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 77/168] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:32 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:32.528967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-9874ba58-c03e-4d1b-a237-36dd5cb7b072 req-47ac8088-4e98-4812-9984-d1e3c1a52d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db3aac8-68f8-4028-8905-acb495f6ab89", "name": "network-vif-plugged", "status": "completed", "tag": "60e67ba0-1a38-4c2c-8f3b-75d937cf69ec"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:32.539263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9874ba58-c03e-4d1b-a237-36dd5cb7b072 req-47ac8088-4e98-4812-9984-d1e3c1a52d82 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.539886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9874ba58-c03e-4d1b-a237-36dd5cb7b072 req-47ac8088-4e98-4812-9984-d1e3c1a52d82 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.540316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9874ba58-c03e-4d1b-a237-36dd5cb7b072 req-47ac8088-4e98-4812-9984-d1e3c1a52d82 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:32.552200 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-9874ba58-c03e-4d1b-a237-36dd5cb7b072 req-47ac8088-4e98-4812-9984-d1e3c1a52d82 service nova] Creating event network-vif-plugged:60e67ba0-1a38-4c2c-8f3b-75d937cf69ec for instance 6db3aac8-68f8-4028-8905-acb495f6ab89 on hv-cinder-85752 Sep 15 00:45:32.558270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-9874ba58-c03e-4d1b-a237-36dd5cb7b072 req-47ac8088-4e98-4812-9984-d1e3c1a52d82 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032783 Sep 15 00:45:32.558875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 92/169] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:45:32.733685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:32.734303 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:32.740237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.740724 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.741163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:32.741856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.742314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.742742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:32.803898 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:32.811742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ed9fc22b-5fa4-4b80-8a41-65b2205f35d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.081958 Sep 15 00:45:32.812306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 78/170] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:32 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:32.813164 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:32.813986 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:32.820206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.820692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.821132 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:32.821867 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.822342 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.822751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:32.955379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:32.964093 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-09cee256-21c7-473d-aa7f-6dc96e5e03b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.155309 Sep 15 00:45:32.964801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 93/171] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:32 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:32.979692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:32.980334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:32.986180 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.986659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.987087 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:32.987810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:32.988263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:32.988733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:33.131186 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:33.142530 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-891bd521-fd2b-44e7-873b-d0f77111f06e tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.166434 Sep 15 00:45:33.143322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 79/172] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:32 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:33.481484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:33.482009 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:33.488388 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:33.488868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:33.489300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:33.489988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:33.490440 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:33.490859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:33.621552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:33.630512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c1668009-e8d0-424e-85cb-28384ba21b0e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.152955 Sep 15 00:45:33.631529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 94/173] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:33 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:33.835209 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:33.836028 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:33.842727 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:33.843504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:33.844026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:33.845052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:33.845671 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:33.846348 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:33.941740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:33.949323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3007da03-013e-4e28-be90-f25a61d69543 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1217 microversion: 2.1 time: 0.118393 Sep 15 00:45:33.949887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 80/174] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:33 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:33.986206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:33.986779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:33.992827 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:33.993323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:33.993769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:33.994480 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:33.994940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:33.995600 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:34.133011 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:34.140719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-09473abf-3d0b-46d0-863f-5422be2b1478 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.158497 Sep 15 00:45:34.141436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 95/175] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:33 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:34.169076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:34.169685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:34.176070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:34.176556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:34.176991 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:34.177675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:34.178125 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:34.178544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:34.309429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:34.318023 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9e680cc2-a407-4894-a657-818c97e62d0b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.152761 Sep 15 00:45:34.318802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 81/176] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:34 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:34.653505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:34.654117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:34.660617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:34.661104 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:34.661540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:34.662233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:34.662689 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:34.663114 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:34.787928 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:34.795436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d7acc4f0-7782-4979-ac35-489ddccb01db tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.145773 Sep 15 00:45:34.796023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 96/177] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:34 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:34.972934 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:34.973554 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:34.979769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:34.980252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:34.980685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:34.981379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:34.981831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:34.982249 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:35.041535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:35.048999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4753c718-5d06-4154-aa30-ee65d66396a7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1209 microversion: 2.1 time: 0.080642 Sep 15 00:45:35.049557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 82/178] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:34 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:35.163161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:35.163802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:35.169823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:35.170310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:35.170748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:35.171446 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:35.171989 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:35.172416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:35.302519 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:35.310183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9446cada-0bcc-4b4b-bf6b-a984743528cd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.150783 Sep 15 00:45:35.310743 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 97/179] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:35 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:35.340323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:35.340931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:35.347204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:35.347731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:35.348162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:35.348848 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:35.349300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:35.349726 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:35.480169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:35.487802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4c8ea424-c407-4d53-a386-ee8e8606a5ee tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.151276 Sep 15 00:45:35.488364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 83/180] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:35 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:35.818756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:35.819307 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:35.825237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:35.825719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:35.826156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:35.826847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:35.827310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:35.827787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:35.953316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:35.962961 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c2918831-b9d8-4798-bb8e-4ac7aa0ec44d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.148123 Sep 15 00:45:35.963542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 98/181] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:35 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:36.072569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:36.073231 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:36.079499 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:36.079994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:36.080429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:36.081143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:36.081597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:36.082022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:36.141323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:36.148840 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eefcdfee-c5a6-4d9c-915f-51c1e055848e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1209 microversion: 2.1 time: 0.080593 Sep 15 00:45:36.149406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 84/182] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:36 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:36.332613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:36.333225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:36.335179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:36.341207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:36.341700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:36.342139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:36.342839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:36.343296 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:36.344366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:36.472906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:36.480430 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6a6973ed-e434-4de3-84d2-12b918b3fa76 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.151621 Sep 15 00:45:36.480982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 99/183] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:36 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:36.510265 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:36.510959 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:36.517348 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:36.517905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:36.518436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:36.519264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:36.519853 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:36.520368 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:36.643922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:36.651377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-561be23c-0069-4a03-8e33-b605cde752cc tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.144924 Sep 15 00:45:36.651958 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 85/184] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:36 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:36.984506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:36.985170 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:36.991023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:36.991529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:36.991975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:36.992673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:36.993134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:36.993560 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:37.122717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:37.131519 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2f6c145e-5d64-4725-95e5-f844da8c3a91 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.150746 Sep 15 00:45:37.132274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 100/185] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:36 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:37.172560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:37.173166 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:37.178931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:37.179433 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:37.179894 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:37.180583 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:37.181081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:37.181503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:37.267306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:37.275612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-35dbd0e4-7c11-4858-9e7d-0322b38123a3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1209 microversion: 2.1 time: 0.107375 Sep 15 00:45:37.276315 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 86/186] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:37 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:37.503310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:37.503913 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:37.510206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:37.510696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:37.511139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:37.511870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:37.512332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:37.512759 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:37.659529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:37.668869 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e06b52e2-9d03-43ab-bd90-8e67a9f02ae5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.169492 Sep 15 00:45:37.669919 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 101/187] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:37 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:37.677711 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:37.678171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:37.686234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:37.689974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:37.690443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:37.691159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:37.691652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:37.692085 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:37.915661 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:37.924183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-db98ce8e-1f29-4be0-807b-9c693ec316de tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.252460 Sep 15 00:45:37.925044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 87/188] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:37 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:38.123355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-d9fe76e0-da97-4ace-a187-8fa8baff532e req-84ebeceb-3d9c-4415-9e9a-982adf63cf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3368c45f-e52e-42fd-8f8c-43e3aeb5aeef", "name": "network-vif-plugged", "status": "completed", "tag": "a181a6dc-2e9a-4e22-a218-adf5eb7e3779"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:38.132832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-d9fe76e0-da97-4ace-a187-8fa8baff532e req-84ebeceb-3d9c-4415-9e9a-982adf63cf5f service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.133404 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-d9fe76e0-da97-4ace-a187-8fa8baff532e req-84ebeceb-3d9c-4415-9e9a-982adf63cf5f service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.133903 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-d9fe76e0-da97-4ace-a187-8fa8baff532e req-84ebeceb-3d9c-4415-9e9a-982adf63cf5f service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:38.149371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-d9fe76e0-da97-4ace-a187-8fa8baff532e req-84ebeceb-3d9c-4415-9e9a-982adf63cf5f service nova] Creating event network-vif-plugged:a181a6dc-2e9a-4e22-a218-adf5eb7e3779 for instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef on hv-cinder-85752 Sep 15 00:45:38.153783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:38.154475 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:38.154583 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-d9fe76e0-da97-4ace-a187-8fa8baff532e req-84ebeceb-3d9c-4415-9e9a-982adf63cf5f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034873 Sep 15 00:45:38.155148 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 102/189] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:45:38.159880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=96 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:38.161604 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.162269 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.162708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:38.163414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.163906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.164331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:38.299159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:38.299897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:38.306526 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.306871 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.307315 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:38.308215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.309331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.309767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:38.315472 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:38.322932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-faf56129-52d1-469e-866c-e0b345d31c57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.172855 Sep 15 00:45:38.323503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 88/190] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:38 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:38.373542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:38.382182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-899b57d9-10bf-4dba-9666-fe2badd17aa7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.087552 Sep 15 00:45:38.382743 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 103/191] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:38 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:38.693878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:38.694574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:38.700414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.700991 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.701497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:38.702611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.703230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.703881 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:38.847336 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:38.855181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aeef4889-ed6d-4a7c-95f0-b4e4371822a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.165802 Sep 15 00:45:38.855748 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 89/192] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:38 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:38.945962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:38.946568 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:38.952850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.953320 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.953808 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:38.954578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:38.955033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:38.955457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:39.086795 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:39.090294 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:39.095762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-894df1ba-0f6e-452c-988d-7b8fdcaba834 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.153529 Sep 15 00:45:39.096405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 104/193] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:38 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:39.346857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:39.347541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:39.353804 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:39.354295 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:39.354733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:39.355431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:39.355917 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:39.356345 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:39.405599 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:39.406858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:39.412839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:39.413393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:39.413848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:39.414541 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:39.414979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:39.415399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:39.478281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:39.484984 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:39.485815 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8b44da30-f827-47b3-9280-eba21fc1b188 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.084305 Sep 15 00:45:39.486388 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 105/194] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:39 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:39.492694 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-778b78ae-30d8-4300-baad-5acbc44d8eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.150600 Sep 15 00:45:39.493243 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 90/195] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:39 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:39.879719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:39.880340 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:39.886428 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:39.886914 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:39.887358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:39.888088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:39.888552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:39.888982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:40.016853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:40.024419 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-84818b6a-b358-4aa9-b80d-64164d6eeca6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.148570 Sep 15 00:45:40.024986 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 106/196] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:39 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:40.118795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:40.119529 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:40.125968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:40.126476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:40.126898 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:40.127608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:40.128061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:40.128481 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:40.260447 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:40.263844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:40.269110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-92051537-c87f-4c0d-a82e-62bdc3f0ab60 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.154223 Sep 15 00:45:40.269671 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 91/197] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:40 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:40.508783 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:40.509325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:40.515254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:40.515749 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:40.515749 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:40.515932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:40.516198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:40.516901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:40.517359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:40.517956 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:40.521628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:40.522116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:40.522559 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:40.523267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:40.523923 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:40.524354 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:40.587469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:40.595625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2e072d41-73ec-4630-8d60-f3f384278bb2 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.090976 Sep 15 00:45:40.596228 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 107/198] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:40 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:40.650628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:40.658671 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-85effef1-8329-40fe-a473-af6f9d3c0cc7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.147499 Sep 15 00:45:40.659222 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 92/199] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:40 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:41.046424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:41.047020 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:41.052863 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:41.053348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:41.053785 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:41.054476 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:41.054934 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:41.055390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:41.180279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:41.187778 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-991ac0b5-d4e4-4d07-9fbb-eb5561cdb44f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.145318 Sep 15 00:45:41.188336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 108/200] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:41 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:41.292020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:41.292634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:41.298600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:41.299036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:41.299495 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:41.300197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:41.300657 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:41.301085 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:41.440233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:41.447976 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7c3ae889-3bb9-4c29-af37-850bb93afdbf tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.159837 Sep 15 00:45:41.448610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 93/201] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:41 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:41.618671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:41.619281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:41.625769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:41.626247 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:41.626681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:41.627363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:41.627844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:41.628265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:41.681136 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:41.681753 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:41.688388 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:41.688871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:41.689310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:41.690011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:41.690470 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:41.690894 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:41.692196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:41.699834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-70c8c540-1389-4042-a866-8502a4d22dcd tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.084911 Sep 15 00:45:41.700398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 109/202] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:41 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:41.816609 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:41.824200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-43c91254-35dc-4d21-9431-732f7b662087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.147004 Sep 15 00:45:41.830164 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 94/203] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:41 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:42.210735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:42.211529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:42.219333 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:42.219861 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:42.220746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:42.221515 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:42.221979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:42.222416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:42.369238 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:42.376794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-abd7be86-10e7-4269-ab8f-1cb148de4241 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.170639 Sep 15 00:45:42.377397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 110/204] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:42 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:42.471909 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:42.472519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:42.479085 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:42.479729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:42.480198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:42.481078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:42.481536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:42.481965 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:42.629923 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:42.638301 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0d0cfc5a-b99b-40d1-bcd9-b6b3f6d5fde3 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.171169 Sep 15 00:45:42.638864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 95/205] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:42 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:42.722658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:42.723394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:42.730437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:42.730892 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:42.734061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:42.734061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:42.734061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:42.734061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:42.800156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:42.807809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-047781bf-0007-4d00-badf-2842e0b6f0eb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.089674 Sep 15 00:45:42.808368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 111/206] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:42 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:42.846115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:42.846733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:42.853927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:42.854629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:42.855086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:42.855874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:42.856361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:42.856790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:42.981479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:42.989060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b3f84c80-9753-47ca-b66c-a61dbb8ff271 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.146694 Sep 15 00:45:42.989626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 96/207] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:42 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:43.400939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:43.401569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:43.407457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:43.407962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:43.408394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:43.409078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:43.409529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:43.409951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:43.539316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:43.547801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5e8ab0fe-2202-4132-95e9-7ff5d52588ea tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.150553 Sep 15 00:45:43.548478 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 112/208] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:43 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:43.661746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:43.662383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:43.668235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:43.668752 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:43.669187 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:43.669875 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:43.670326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:43.670747 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:43.795279 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:43.803278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-24c48903-e626-403b-b7d1-446fb0688952 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.145397 Sep 15 00:45:43.803863 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 97/209] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:43 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:43.830012 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:43.830618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:43.836491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:43.836972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:43.837396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:43.838084 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:43.838530 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:43.838950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:43.903143 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:43.911474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5abcf81b-a6d0-4fe3-998a-33eddebf358b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.085258 Sep 15 00:45:43.912069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 113/210] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:43 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:44.011960 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:44.012573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:44.018935 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:44.019423 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:44.019902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:44.020596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:44.021051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:44.021498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:44.148633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:44.157672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-861ffb07-d82a-4fb0-b491-4c073a66eb5f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.149514 Sep 15 00:45:44.158226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 98/211] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:44 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:44.570287 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:44.570823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:44.576751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:44.577236 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:44.578292 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:44.578984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:44.579443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:44.579896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:44.719352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:44.728504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1869f7da-202f-4f11-a458-9e350828160d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.162130 Sep 15 00:45:44.729076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 114/212] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:44 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:44.825687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:44.826326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:44.832255 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:44.832734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:44.833167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:44.833855 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:44.834303 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:44.834729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:44.933943 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:44.934545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:44.941144 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:44.941838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:44.942273 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:44.942971 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:44.943423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:44.943872 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:44.966407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:44.973977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bdb77cee-c3cf-4c73-ba10-d9346cb910ce tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.152019 Sep 15 00:45:44.974543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 99/213] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:44 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:45.017570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:45.025307 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7f398d91-c036-4865-96cb-013549a73c83 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.095104 Sep 15 00:45:45.025874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 115/214] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:44 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:45.180368 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:45.180919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:45.186797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:45.187292 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:45.187837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:45.188533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:45.188991 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:45.189416 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:45.316590 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:45.324216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9e3d2178-a81f-4fbe-b76a-49e7b69c93b7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.147825 Sep 15 00:45:45.324767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 100/215] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:45 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:45.751750 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:45.752358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:45.758587 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:45.759074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:45.759529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:45.760226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:45.760678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:45.761101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:45.887427 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:45.895723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-40e8b416-eade-4460-8ee0-f16a96cb3467 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.148316 Sep 15 00:45:45.896408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 116/216] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:45 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:45.996981 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:45.997597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:46.003967 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:46.004454 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:46.004895 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:46.005844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:46.006298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:46.006723 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:46.051677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:46.051677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:46.055916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:46.055916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:46.055916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:46.055916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:46.056283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:46.056620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:46.116941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:46.125060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ff50ca15-f86f-4e47-b6fe-790d603169bf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.080677 Sep 15 00:45:46.133107 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 117/217] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:46 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:46.135006 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:46.142528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-149448f3-2cb4-4b35-92e8-45d0e9634870 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.149391 Sep 15 00:45:46.143078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 101/218] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:45 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:46.346314 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:46.347151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:46.353503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:46.353989 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:46.354428 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:46.355123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:46.355608 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:46.356037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:46.482279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:46.490427 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c69e0dfd-f94d-433b-b914-04883716dd80 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.148153 Sep 15 00:45:46.490989 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 118/219] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:46 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:46.918037 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:46.918649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:46.924576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:46.925062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:46.925492 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:46.926175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:46.926678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:46.927043 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:47.050305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:47.057861 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1b759d18-f80b-414c-ba59-787f8f38bbf2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.143591 Sep 15 00:45:47.058441 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 102/220] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:46 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:47.148848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:47.149460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:47.156132 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:47.156614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:47.157056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:47.157762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:47.158207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:47.158661 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:47.164972 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:47.165589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:47.171471 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:47.171991 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:47.172427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:47.173124 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:47.173584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:47.174031 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:47.221413 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:47.229219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-49266079-0291-4d72-971a-cf7d364c615a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.084818 Sep 15 00:45:47.229783 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 119/221] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:47 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:47.307216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:47.315572 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-23a1b301-b3e4-4f3e-8cee-ffdee19fbddb tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.154681 Sep 15 00:45:47.316137 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 103/222] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:47 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:47.514426 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:47.515614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:47.522421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:47.522904 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:47.523344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:47.524095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:47.524547 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:47.524969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:47.659594 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:47.667817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e7be338f-06d9-4ec6-82c6-609d5edb2fae tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.157501 Sep 15 00:45:47.668570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 120/223] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:47 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:47.992408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-bc1130d1-7c60-4979-99b4-04e0a342f293 req-b63a2551-b12e-48b1-b4af-a2e169fbd6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d301ea-7505-4d72-8061-827894477da0", "name": "network-vif-plugged", "status": "completed", "tag": "45e2672c-5f66-4187-b159-c6d3bb80d12b"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:48.009114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bc1130d1-7c60-4979-99b4-04e0a342f293 req-b63a2551-b12e-48b1-b4af-a2e169fbd6ea service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.009114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bc1130d1-7c60-4979-99b4-04e0a342f293 req-b63a2551-b12e-48b1-b4af-a2e169fbd6ea service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.009114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bc1130d1-7c60-4979-99b4-04e0a342f293 req-b63a2551-b12e-48b1-b4af-a2e169fbd6ea service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.038439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-bc1130d1-7c60-4979-99b4-04e0a342f293 req-b63a2551-b12e-48b1-b4af-a2e169fbd6ea service nova] Creating event network-vif-plugged:45e2672c-5f66-4187-b159-c6d3bb80d12b for instance c1d301ea-7505-4d72-8061-827894477da0 on hv-cinder-85752 Sep 15 00:45:48.045929 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bc1130d1-7c60-4979-99b4-04e0a342f293 req-b63a2551-b12e-48b1-b4af-a2e169fbd6ea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 00:45:48.046451 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bc1130d1-7c60-4979-99b4-04e0a342f293 req-b63a2551-b12e-48b1-b4af-a2e169fbd6ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=127199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 00:45:48.048287 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.050012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.050452 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.051325 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.056601 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.059020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.081318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.compute.rpcapi [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 00:45:48.082322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:48.082431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] Releasing lock "compute-rpcapi-router" {{(pid=127199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 00:45:48.082987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:48.096553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.098566 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.099171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.099971 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e97d83d2-a0c9-423a-b0ed-72b0ca13f714 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111230 Sep 15 00:45:48.100685 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.101898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.102593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.104935 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 104/224] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:45:48.128206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:48.256285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:48.258356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:48.272686 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.273192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.273636 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.276749 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.277226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.284166 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.349801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:48.360807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-74fb994d-af02-4e88-8f5a-461f45a15ee9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.284462 Sep 15 00:45:48.361378 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 121/225] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:48 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:48.362523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:48.376223 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9cec2ffa-36db-4cfb-867f-639faf632a36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1265 microversion: 2.1 time: 0.125539 Sep 15 00:45:48.376416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:48.377268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 105/226] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:48 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:48.379365 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:48.386991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.387664 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.388529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.389481 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.390229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.390850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.549865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:48.561208 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-82f697f5-a4ee-4954-a6d5-fa494326fcb0 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1315 microversion: 2.1 time: 0.197553 Sep 15 00:45:48.582365 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 122/227] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:48 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:48.691629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:48.692246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:48.704583 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.706036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.706633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.707645 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:48.708366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:48.709259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:48.930351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:48.938022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-408537aa-933f-48ee-bc4e-361cdf2834fe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.250818 Sep 15 00:45:48.938592 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 106/228] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:48 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:49.384619 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:49.385397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:49.394762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:49.395579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:49.396260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:49.397370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:49.398121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:49.399113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:49.400842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:49.402810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:49.416632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:49.417073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:49.417713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:49.418593 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:49.419408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:49.419868 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:49.523219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:49.534246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0e0f2d5e-c32f-4b5a-9540-5cc7a8cafb30 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1283 microversion: 2.1 time: 0.137209 Sep 15 00:45:49.534839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 107/229] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:49 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1283 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:49.582758 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:49.592529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6f3a5001-3249-4f86-9406-091fbd4837af tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.211807 Sep 15 00:45:49.593360 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:49.593992 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 123/230] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:49 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:49.596051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:49.602046 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:49.602660 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:49.603370 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:49.604474 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:49.605125 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:49.605731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:49.881121 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:49.885024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:49.899740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dc3d52f9-d860-47ad-9fc3-27c2957373c7 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1502 microversion: 2.1 time: 0.312773 Sep 15 00:45:49.900463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 108/231] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:49 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:49.961844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:49.962826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:49.974551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:49.976483 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:49.977089 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:49.977834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:49.978303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:49.978732 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:50.343409 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:50.353937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ac7a7ccf-6a93-49b1-8da6-76f3d8cd467d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.396471 Sep 15 00:45:50.354762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 124/232] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:49 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:50.560029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:50.562228 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:50.568754 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:50.569310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:50.569993 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:50.570775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:50.571305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:50.571834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:50.618137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:50.618807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:50.626952 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:50.627599 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:50.628434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:50.629738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:50.630862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:50.631568 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:50.664126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:50.674860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c4c4e392-b26c-437f-8d9e-bc30d7096e6d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1271 microversion: 2.1 time: 0.120375 Sep 15 00:45:50.687089 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 109/233] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:50 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:50.794988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:50.802660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1295d0d8-e5b0-42db-a3eb-c026b7dd6251 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.189703 Sep 15 00:45:50.817764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 125/234] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:50 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:51.380111 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:51.381255 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:51.388471 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:51.389036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:51.389614 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:51.390656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:51.391394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:51.392043 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:51.526955 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:51.535637 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cf277cc8-7577-4b5f-8d5b-436f34c50ef2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.159523 Sep 15 00:45:51.536206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 110/235] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:51 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:51.701221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:51.701861 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:51.709646 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:51.710137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:51.710572 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:51.711272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:51.711927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:51.712354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:51.782995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:51.791950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2eb6851e-c283-42af-bca3-fd46bb14643d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1271 microversion: 2.1 time: 0.094947 Sep 15 00:45:51.792509 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 126/236] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:51 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:51.824783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:51.825400 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:51.831961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:51.832460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:51.832911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:51.833658 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:51.834128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:51.834560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:51.983420 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:51.992004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-efffe7de-92c6-4d96-9b7f-97184ce73d0e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.170916 Sep 15 00:45:51.992633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 111/237] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:51 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:52.558762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:52.559416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:52.565576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:52.566070 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:52.566509 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:52.567216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:52.567713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:52.568138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:52.707324 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:52.715055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-df8e27f6-f1f5-41e9-81a6-22639d1da669 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.160008 Sep 15 00:45:52.715825 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 127/238] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:52 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:52.815386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:52.816031 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:52.822377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:52.822950 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:52.823386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:52.824278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:52.824737 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:52.825181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:52.891446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:52.899076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e0bde9f9-1073-4dc3-883d-ceaaa4a16c3e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1271 microversion: 2.1 time: 0.087508 Sep 15 00:45:52.899742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 112/239] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:52 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:53.017004 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:53.017727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:53.023579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:53.024069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:53.024502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:53.025244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:53.025710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:53.026134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:53.202838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:53.210790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-88815909-3677-4ae9-a67c-a64b54b3d538 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.198327 Sep 15 00:45:53.211354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 128/240] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:53 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:53.738480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:53.739199 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:53.745137 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:53.745633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:53.746076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:53.746773 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:53.747406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:53.747864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:53.890362 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:53.900618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ba3d8983-a69d-48b8-8670-ae51c3c69110 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.165945 Sep 15 00:45:53.901195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 113/241] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:53 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:53.923129 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:53.923802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:53.929766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:53.930255 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:53.930696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:53.931385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:53.931887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:53.932349 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:53.994471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:54.002642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-deae5e59-39e6-497f-a309-5a7f5ee094b0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1271 microversion: 2.1 time: 0.084081 Sep 15 00:45:54.003359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 129/242] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:53 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:54.234557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:54.235207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:54.241093 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:54.241581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:54.242019 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:54.242715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:54.243176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:54.243749 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:54.372576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:54.381152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8f18b855-d1a1-4bde-800c-f8b90d29ff63 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.151062 Sep 15 00:45:54.382033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 114/243] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:54 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:54.923840 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:54.925010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:54.933298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:54.934012 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:54.934511 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:54.936174 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:54.937207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:54.937644 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:55.027035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:55.027953 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:55.035070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:55.035716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:55.036398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:55.037174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:55.037844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:55.038866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:55.116803 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:55.125435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1788e90d-148d-46df-b12d-bf0519c3cd15 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1271 microversion: 2.1 time: 0.103819 Sep 15 00:45:55.126010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 115/244] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:55 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:55.174002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:55.182617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c92693e1-05cb-496c-b32e-ccb5ccab37e0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.264227 Sep 15 00:45:55.183186 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 130/245] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:54 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:55.404893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:55.405569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:55.411389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:55.411912 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:55.412351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:55.413050 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:55.413546 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:55.413934 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:55.600416 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:55.610249 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b4b75345-f575-411d-9ad7-65055558f8d8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.209520 Sep 15 00:45:55.610973 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 116/246] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:55 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:56.148301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:56.148923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:56.154595 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.155658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.156103 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:56.156790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.157399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.157827 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:56.206469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:56.207076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:56.213293 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.213791 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.214222 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:56.215108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.215589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.216242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:56.387164 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:56.396956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2c7a9ce0-c35a-4e13-b891-54ae8a5f05c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1322 microversion: 2.1 time: 0.194524 Sep 15 00:45:56.399512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 117/247] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:56 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:56.410493 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:56.421362 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4dc6b5c1-ff3d-4dbb-b252-4932946b2867 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.276723 Sep 15 00:45:56.422574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 131/248] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:56 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:56.640687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:56.641490 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:56.648609 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.649268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.649870 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:56.650713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.651305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.651906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:56.727422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c9f88f2-79cf-4dd2-84b1-f0759e3252fb"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:56.730017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:56.738958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.739660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.740280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:56.741275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.741884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.743211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:56.916814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:56.935246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-67d2b961-dff5-4fac-b77c-016003cab706 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.297478 Sep 15 00:45:56.957300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 118/249] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:56 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:56.974837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-055f6d1d-b9ce-465c-a581-eb7bfdc0ed6d req-c08bef13-0e8e-4e55-aa25-08dbc7aebdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f02a2a-8587-4092-88f3-48cbdfc96193", "tag": "1d459fdc-f5b1-4917-a5b5-eeb565ca4f6a"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:56.988633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-055f6d1d-b9ce-465c-a581-eb7bfdc0ed6d req-c08bef13-0e8e-4e55-aa25-08dbc7aebdf5 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:56.989540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-055f6d1d-b9ce-465c-a581-eb7bfdc0ed6d req-c08bef13-0e8e-4e55-aa25-08dbc7aebdf5 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:56.990045 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-055f6d1d-b9ce-465c-a581-eb7bfdc0ed6d req-c08bef13-0e8e-4e55-aa25-08dbc7aebdf5 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:57.010399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-055f6d1d-b9ce-465c-a581-eb7bfdc0ed6d req-c08bef13-0e8e-4e55-aa25-08dbc7aebdf5 service nova] Creating event network-changed:1d459fdc-f5b1-4917-a5b5-eeb565ca4f6a for instance 30f02a2a-8587-4092-88f3-48cbdfc96193 on hv-cinder-85752 Sep 15 00:45:57.015947 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-055f6d1d-b9ce-465c-a581-eb7bfdc0ed6d req-c08bef13-0e8e-4e55-aa25-08dbc7aebdf5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048369 Sep 15 00:45:57.016554 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 119/250] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:45:57.420605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:57.421504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:57.436530 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:57.440667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:57.441173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:57.442172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:57.442843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:57.443240 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:57.800334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:57.808693 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-00998e9b-d3aa-4443-bef5-872d9bb1c928 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1515 microversion: 2.1 time: 0.392584 Sep 15 00:45:57.819668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 120/251] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:57 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:57.819668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:57.819668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:57.823701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:57.824280 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:57.824924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:57.825725 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:57.826544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:57.827751 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:57.968422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:57.976657 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-667e6107-d29c-48af-a8a7-b8d8433aa3f3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.166375 Sep 15 00:45:57.977562 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 121/252] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:57 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:57.982622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:45:57.985039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:57.992141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:57.992696 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:57.993118 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:57.994018 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:57.994592 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:57.995004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:58.059284 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lazy-loading 'flavor' on Instance uuid 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:45:58.093294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:58.196811 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-68ad27dd-dcba-4c83-ba71-8b66629d9950 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef/action" status: 200 len: 32 microversion: 2.1 time: 0.217789 Sep 15 00:45:58.197415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 122/253] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:45:57 2022] POST /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 00:45:58.207056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:58.207971 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:58.214037 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:58.214523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:58.215116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:58.216337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:58.216788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:58.217215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:58.407120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:58.415595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5a7f5dec-d761-4409-bad9-d831c08089bd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.212483 Sep 15 00:45:58.417341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 123/254] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:58 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:58.424266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:58.427528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:58.434460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:58.434981 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:58.435515 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:58.436180 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:58.437191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:58.437611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:58.460022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:58.593783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:58.604531 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-67242d9b-1e75-4759-82a0-6289017570a2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.186469 Sep 15 00:45:58.605103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 124/255] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:58 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:45:59.000456 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:59.001095 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:59.007224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:59.007742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:59.008342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:59.009056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:59.009515 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:59.009940 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:59.144872 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:59.152542 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-40ea2107-70dc-48b1-a789-240b808450ea tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.155899 Sep 15 00:45:59.153109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 125/256] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:58 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:59.447141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:59.447955 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:59.455951 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:59.456373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:59.456817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:59.457557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:59.457964 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:59.458505 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:59.586438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:59.594508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e375c655-8a09-4aa7-ae63-280d04b5140c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.151261 Sep 15 00:45:59.595079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 126/257] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:59 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:45:59.628196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:45:59.628899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:45:59.635243 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:59.635839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:59.636357 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:59.637124 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:45:59.637601 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:45:59.638033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:45:59.783120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:45:59.811986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e494d9bd-fe1a-43ee-8c48-a5bb17925fec tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.187555 Sep 15 00:45:59.813474 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 127/258] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:45:59 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:00.176143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:00.176760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:00.182632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:00.183120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:00.183587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:00.184286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:00.184743 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:00.185171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:00.309850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:00.317397 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a74aee4c-17c0-45a0-81a8-54602ab0fcb1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.145049 Sep 15 00:46:00.317961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 128/259] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:00 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:00.617227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:00.617870 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:00.623856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:00.624346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:00.624785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:00.625481 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:00.625943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:00.626424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:00.756792 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:00.765044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-87192609-b812-4d60-93f8-418b736116ca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.150912 Sep 15 00:46:00.765596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 129/260] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:00 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:00.835177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:00.835841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:00.841587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:00.842073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:00.842506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:00.843195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:00.843690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:00.844114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:00.969053 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:00.976682 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-84d9011e-dbdd-4c56-9e16-9e11555be3d4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.145446 Sep 15 00:46:00.977242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 130/261] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:00 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:01.339546 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:01.340201 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:01.346314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:01.346817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:01.347257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:01.347986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:01.348447 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:01.348876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:01.476182 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:01.484166 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eb918edd-f2c6-4fb9-b97c-0bdc9a926247 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.148535 Sep 15 00:46:01.484740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 131/262] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:01 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:01.787119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:01.787749 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:01.793630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:01.794119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:01.794563 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:01.795259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:01.796370 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:01.796808 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:01.922495 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:01.930259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2a8f47cc-ee41-41e0-86b1-b022b2efa684 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.146861 Sep 15 00:46:01.930772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 132/263] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:01 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:01.998975 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:01.999612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:02.005705 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:02.006197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:02.006642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:02.007339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:02.007826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:02.008261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:02.133215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:02.141290 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-66fca40b-db09-4bcc-b1e9-1eed641b6837 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.146116 Sep 15 00:46:02.141871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 133/264] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:01 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:02.506805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:02.507425 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:02.513291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:02.513781 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:02.514845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:02.515574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:02.516045 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:02.516472 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:02.644200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:02.651967 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fe2cd99c-be59-4688-8f3c-45d7286678ca tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.149159 Sep 15 00:46:02.652527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 134/265] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:02 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:02.951925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:02.952543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:02.958641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:02.959127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:02.959587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:02.960310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:02.960760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:02.961182 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:03.087337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:03.095405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-97047365-88a2-4eac-a8e0-ecccb146b7c0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1361 microversion: 2.1 time: 0.147378 Sep 15 00:46:03.096181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 135/266] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:02 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:03.164327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:03.164936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:03.171440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:03.171953 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:03.172389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:03.173085 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:03.173536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:03.173957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:03.308837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:03.316521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bd9f7076-b35e-43c7-b1f7-828fe3e38f83 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.156036 Sep 15 00:46:03.317298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 136/267] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:03 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:03.394414 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5fa73cdb-a038-42bc-ab7b-0d3fa0eb072b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "POST /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.674721 Sep 15 00:46:03.395027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 132/268] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:45:56 2022] POST /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89/os-volume_attachments => generated 194 bytes in 6676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:46:03.675114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:03.675874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:03.683132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:03.684147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:03.684720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:03.685695 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:03.686295 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:03.686864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:03.836263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:03.845683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-37acda31-0fd7-4cf2-b458-84e1236c7b36 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.174299 Sep 15 00:46:03.846711 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 137/269] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:03 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:04.120445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:04.121137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:04.127910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:04.128405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:04.128844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:04.129538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:04.129999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:04.130685 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:04.261865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:04.269531 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e70a08d4-409a-406e-9ecb-26a9806182b5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1546 microversion: 2.1 time: 0.153835 Sep 15 00:46:04.270115 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 133/270] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:04 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:04.292004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:04.292500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:04.294409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:04.300083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:04.300565 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:04.300995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:04.301687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:04.302141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:04.302612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:04.343988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:04.344781 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:04.351713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:04.352282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:04.352809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:04.353620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:04.354287 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:04.354844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:04.384026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-792f369c-35e1-400a-9c09-d9bcc9a5a714 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095866 Sep 15 00:46:04.384692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 138/271] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 00:46:04 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:46:04.489816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:04.500197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6041e542-7c05-4118-b683-84add17b79b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.165972 Sep 15 00:46:04.500966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 134/272] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:04 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:04.870430 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:04.870957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:04.876977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:04.877468 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:04.877904 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:04.878598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:04.879060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:04.879501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:05.143567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:05.151119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-153269d6-3b52-4dd0-b78b-e2043b5f45c0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.284904 Sep 15 00:46:05.151714 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 139/273] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:04 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:05.523095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:05.523866 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:05.531042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:05.531585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:05.532042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:05.532963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:05.533499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:05.535325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:05.677455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:05.684838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-002b407e-abd9-4544-ace7-352e87836c73 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.165634 Sep 15 00:46:05.685579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 135/274] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:05 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:05.749719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-719f985e-02f3-4fa4-a7fb-548f8194cff9 req-72b5e440-9d20-485c-bd75-08b29cb65eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d301ea-7505-4d72-8061-827894477da0", "tag": "45e2672c-5f66-4187-b159-c6d3bb80d12b"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:05.759300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-719f985e-02f3-4fa4-a7fb-548f8194cff9 req-72b5e440-9d20-485c-bd75-08b29cb65eb9 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:05.759909 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-719f985e-02f3-4fa4-a7fb-548f8194cff9 req-72b5e440-9d20-485c-bd75-08b29cb65eb9 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:05.760412 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-719f985e-02f3-4fa4-a7fb-548f8194cff9 req-72b5e440-9d20-485c-bd75-08b29cb65eb9 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:05.771790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-719f985e-02f3-4fa4-a7fb-548f8194cff9 req-72b5e440-9d20-485c-bd75-08b29cb65eb9 service nova] Creating event network-changed:45e2672c-5f66-4187-b159-c6d3bb80d12b for instance c1d301ea-7505-4d72-8061-827894477da0 on hv-cinder-85752 Sep 15 00:46:05.776921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-719f985e-02f3-4fa4-a7fb-548f8194cff9 req-72b5e440-9d20-485c-bd75-08b29cb65eb9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030970 Sep 15 00:46:05.777499 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 140/275] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:46:06.174123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:06.187862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:06.187862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:06.187862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:06.187862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:06.188180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:06.188180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:06.188180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:06.310586 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:06.314700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:06.319563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-47928d43-ec21-43d7-a3be-53d9b942d07c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.149377 Sep 15 00:46:06.320258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 136/276] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:06 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:06.709899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:06.710629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:06.717204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:06.717728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:06.718163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:06.718869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:06.719323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:06.719776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:06.884824 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:06.888333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:06.893520 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-19774ffb-5cbc-479a-8505-f1f18d26bd1a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.187935 Sep 15 00:46:06.894120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 141/277] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:06 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:07.342977 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:07.343627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:07.345940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=76 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:07.352206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:07.352693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:07.353129 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:07.353827 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:07.354289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:07.354717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:07.484481 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:07.491970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b6ee37c8-e6a8-4db9-b1f6-13d79b54da27 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.153788 Sep 15 00:46:07.492517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 137/278] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:07 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:07.917510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:07.918132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:07.924965 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:07.925452 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:07.925887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:07.926586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:07.927044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:07.927467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:08.051701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:08.059245 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-874488d6-318b-497c-8d84-228062666a65 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.146034 Sep 15 00:46:08.059834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 142/279] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:07 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:08.515154 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:08.515854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:08.522167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:08.522655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:08.523096 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:08.523821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:08.524280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:08.524710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:08.648796 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:08.656996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4451237c-8852-407e-841b-83a9eae9e78b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.145718 Sep 15 00:46:08.657555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 138/280] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:08 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:09.083871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:09.085289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:09.092427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:09.093131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:09.093721 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:09.094587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:09.095204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:09.095805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:09.428978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:09.437701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f2b4c1e6-4d64-44d8-914e-235c4175e839 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.358752 Sep 15 00:46:09.438385 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 143/281] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:09 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:09.679454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:09.680096 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:09.687176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:09.687694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:09.688134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:09.688826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:09.689281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:09.689710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:09.816766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:09.824368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2a72c180-6909-470e-ab9b-2175b05fb138 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.148747 Sep 15 00:46:09.824937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 139/282] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:09 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:10.460504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:10.461116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:10.467075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:10.467596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:10.468039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:10.468731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:10.469191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:10.469623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:10.594571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:10.602073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-02d1783f-f32e-4f0e-9afc-a71bad54bef3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.145402 Sep 15 00:46:10.602630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 144/283] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:10 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:10.848329 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:10.848940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:10.855694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:10.856185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:10.856624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:10.857324 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:10.858486 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:10.858915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:10.990420 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:10.997982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0879840c-880a-425e-98f7-d873863befdf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.153621 Sep 15 00:46:10.998532 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 140/284] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:10 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:11.626126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:11.626754 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:11.633068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:11.633553 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:11.633988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:11.634679 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:11.635132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:11.635579 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:11.759615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:11.767198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ee09dc81-3afb-4635-afe8-d97cc06b85e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.145522 Sep 15 00:46:11.767795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 145/285] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:11 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:12.020590 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:12.021207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:12.027580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:12.028066 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:12.028503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:12.029217 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:12.030146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:12.030572 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:12.153836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:12.161867 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-079f72c6-9fd7-4b88-af4d-8b40f14b74c8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.145066 Sep 15 00:46:12.162424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 141/286] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:12 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:12.789039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:12.789653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:12.795570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:12.796058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:12.796494 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:12.797178 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:12.797636 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:12.798059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:12.932402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:12.940672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5cb69a86-c897-4e85-8566-b00bd3a55d90 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.155402 Sep 15 00:46:12.941241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 146/287] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:12 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:13.184985 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:13.186130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:13.192461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:13.192949 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:13.193390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:13.194080 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:13.194542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:13.194968 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:13.318318 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:13.325826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5d0fbc10-119b-4ff0-ac1d-0a36dc7891fb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.144705 Sep 15 00:46:13.326388 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 142/288] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:13 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:13.964026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:13.964667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:13.971219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:13.971740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:13.972181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:13.972870 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:13.973325 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:13.973746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:14.100554 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:14.108113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9a19848b-129c-458e-8a1e-6e1e66490522 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.147922 Sep 15 00:46:14.108668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 147/289] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:13 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:14.347439 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:14.348073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:14.354407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:14.354889 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:14.355324 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:14.356046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:14.356500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:14.357108 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:14.484231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:14.491747 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d80b2a4e-e7f2-40ab-981f-f44e60df62ad tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.148077 Sep 15 00:46:14.492310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 143/290] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:14 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:15.130492 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:15.131101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:15.136961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:15.137444 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:15.137880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:15.139189 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:15.139680 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:15.140110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:15.267381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:15.274840 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2b61aa44-3383-4a4b-9ed2-156665f7174d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.148413 Sep 15 00:46:15.275397 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 148/291] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:15 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:15.516257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:15.517007 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:15.523270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:15.523859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:15.524296 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:15.524991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:15.525447 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:15.525872 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:15.663580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:15.672370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d0c3de22-f281-4eaa-9126-6dde4cb7eb00 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.159992 Sep 15 00:46:15.673028 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 144/292] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:15 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:16.296718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:16.297363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:16.303221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:16.303758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:16.304201 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:16.304900 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:16.305384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:16.305819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:16.451403 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:16.467881 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e4bbd2c4-43db-4099-86fe-3669ab9833d3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.166790 Sep 15 00:46:16.467881 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 149/293] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:16 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:16.696017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:16.696640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:16.703269 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:16.703801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:16.704243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:16.704943 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:16.705407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:16.706445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:16.851701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:16.860537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6c66e6b4-f468-49f9-9e20-065e21171ca4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.168435 Sep 15 00:46:16.861175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 145/294] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:16 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:17.484717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:17.485980 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:17.492698 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:17.493227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:17.493665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:17.494371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:17.494833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:17.495259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:17.639039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:17.647597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-06a1a9cf-7cb1-40dc-a8c5-6e79b31a067d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.168112 Sep 15 00:46:17.662159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 150/295] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:17 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:17.887355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:17.889253 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:17.896491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:17.897263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:17.898200 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:17.899329 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:17.899962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:17.900563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:18.058032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:18.068212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5fee4fdf-fd31-4a53-a900-389e75579c3a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.187591 Sep 15 00:46:18.068927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 146/296] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:17 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:18.675810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:18.676456 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:18.682735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:18.683242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:18.683906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:18.684607 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:18.685067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:18.685497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:18.815893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:18.823501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-270ece9e-b1c6-4091-8099-3102dbd4299e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.151492 Sep 15 00:46:18.824135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 151/297] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:18 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:19.091971 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:19.092587 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:19.098972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:19.099459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:19.099928 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:19.100651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:19.101111 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:19.101537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:19.234377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:19.242801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ef2300cf-1764-4c08-acfa-8d5f1e1e40e7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.154168 Sep 15 00:46:19.243543 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 147/298] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:19 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:19.846591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:19.847195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:19.853176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:19.853668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:19.854103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:19.854794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:19.855249 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:19.855729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:19.982141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:19.989740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b9179d92-fdb7-48bb-85ed-15f37b424672 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.147040 Sep 15 00:46:19.990440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 152/299] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:19 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:20.266601 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:20.267212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:20.273817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:20.274302 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:20.274737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:20.275456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:20.275932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:20.276353 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:20.401713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:20.409214 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-40d68d63-5857-4e82-9568-6fb8235a284a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.147098 Sep 15 00:46:20.409833 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 148/300] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:20 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:21.012600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:21.013253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:21.019237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:21.019752 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:21.020212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:21.020901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:21.021354 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:21.021780 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:21.145347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:21.152963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9f191ca9-1f62-4d49-8b9e-9e48b4159313 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.144175 Sep 15 00:46:21.153529 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 153/301] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:21 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:21.431109 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:21.431752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:21.439337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:21.439859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:21.440303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:21.441012 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:21.441472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:21.441902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:21.566324 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:21.573835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-01e76582-6711-4f5e-a02c-dbba5481d5b8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.146551 Sep 15 00:46:21.574400 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 149/302] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:21 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:22.175754 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:22.176372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:22.182388 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:22.182875 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:22.183314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:22.184039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:22.184519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:22.184932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:22.312733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:22.320494 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-27735f79-e67c-45aa-bd48-6a7c04644b95 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.148551 Sep 15 00:46:22.321099 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 154/303] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:22 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:22.601537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:22.602148 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:22.609208 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:22.609689 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:22.610127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:22.610814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:22.611267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:22.611715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:22.751963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:22.760576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ae55ffb3-53b0-42b2-8826-d153d2a4cc98 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.162889 Sep 15 00:46:22.761226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 150/304] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:22 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:23.343128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:23.343767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:23.349680 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:23.350169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:23.350608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:23.351310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:23.351797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:23.352232 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:23.483256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:23.491092 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-24c499f7-e96a-4955-a0ed-6d262deee5ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.151786 Sep 15 00:46:23.491826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 155/305] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:23 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:23.782118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:23.782728 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:23.789111 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:23.789601 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:23.790036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:23.790755 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:23.791194 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:23.791656 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:23.924725 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:23.932871 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b8acf3e8-c03b-453b-b35b-153afdd18b0a tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.154727 Sep 15 00:46:23.933476 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 151/306] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:23 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:24.520277 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:24.522343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:24.536140 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:24.536853 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:24.537467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:24.542521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:24.545653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:24.546213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:24.705863 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:24.714784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f3171b5a-b5d6-4c7b-9575-245f9c8ca3d7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.202820 Sep 15 00:46:24.715382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 156/307] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:24 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:24.957459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:24.958017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:24.965303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:24.965794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:24.966238 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:24.966975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:24.967435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:24.967930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:25.145939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:25.160972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b363e37c-5931-4c08-b3ce-43fa5b3de70b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.207422 Sep 15 00:46:25.162191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 152/308] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:24 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:25.526662 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-27186d47-af2d-45fd-b7d1-53743e86eadd req-5e668ec7-f3a6-495d-a17f-60d1020f34a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f02a2a-8587-4092-88f3-48cbdfc96193", "name": "network-vif-plugged", "status": "completed", "tag": "1d459fdc-f5b1-4917-a5b5-eeb565ca4f6a"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:25.543439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-27186d47-af2d-45fd-b7d1-53743e86eadd req-5e668ec7-f3a6-495d-a17f-60d1020f34a7 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:25.545249 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-27186d47-af2d-45fd-b7d1-53743e86eadd req-5e668ec7-f3a6-495d-a17f-60d1020f34a7 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:25.546141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-27186d47-af2d-45fd-b7d1-53743e86eadd req-5e668ec7-f3a6-495d-a17f-60d1020f34a7 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:25.560084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-27186d47-af2d-45fd-b7d1-53743e86eadd req-5e668ec7-f3a6-495d-a17f-60d1020f34a7 service nova] Creating event network-vif-plugged:1d459fdc-f5b1-4917-a5b5-eeb565ca4f6a for instance 30f02a2a-8587-4092-88f3-48cbdfc96193 on hv-cinder-85752 Sep 15 00:46:25.567395 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-27186d47-af2d-45fd-b7d1-53743e86eadd req-5e668ec7-f3a6-495d-a17f-60d1020f34a7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045511 Sep 15 00:46:25.568478 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 157/309] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:46:25.737823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:25.738436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:25.744481 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:25.744980 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:25.745422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:25.746122 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:25.746578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:25.747001 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:25.775347 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:25.924986 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:25.937167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-01c59d31-ca27-42f7-975f-2650dc186fc5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.202796 Sep 15 00:46:25.939018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 153/310] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:25 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:26.196411 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:26.197162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:26.203825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:26.204316 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:26.204751 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:26.205455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:26.206069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:26.206585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:26.396927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:26.404826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4d68f341-e509-467e-b3d9-45e0c9f9ee78 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.212662 Sep 15 00:46:26.405381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 158/311] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:26 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:26.886414 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:26.887522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:26.894007 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:26.894496 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:26.895103 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:26.895847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:26.896309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:26.896737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:26.936625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:46:26.963380 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:26.964175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:26.971108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:26.971688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:26.972134 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:26.973384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:26.973384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:26.975998 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:26.982404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:27.052920 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-96260656-105a-4d0b-b84b-b475891fd4f5 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 204 len: 0 microversion: 2.1 time: 0.170589 Sep 15 00:46:27.053947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 154/312] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:46:26 2022] DELETE /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:46:27.063395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:27.064114 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:27.070321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:27.070813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:27.071791 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:27.071958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:27.072410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:27.072832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:27.132182 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:27.141202 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9f994188-0478-409d-97d1-cae394ac076a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.181850 Sep 15 00:46:27.142311 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 159/313] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:26 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:27.236789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:27.245147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-dc6ce852-7700-4e23-8727-a14ef2e07a53 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1554 microversion: 2.1 time: 0.185959 Sep 15 00:46:27.245757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 155/314] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:27 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:27.429088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:27.429769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:27.436243 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:27.436889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:27.437487 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:27.438191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:27.438654 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:27.439081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:27.567085 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:27.575026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2cc1feb1-b1e2-4adf-bd9f-ca2914bc56f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.150084 Sep 15 00:46:27.576147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 160/315] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:27 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:28.166129 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:28.166768 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:28.173822 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:28.174320 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:28.174767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:28.176027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:28.176499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:28.176933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:28.268827 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:28.270010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:28.276207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:28.277176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:28.277314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:28.277903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:28.278356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:28.279398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:28.317342 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:28.328409 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-903cd9c2-713e-4165-ac61-3b074f228392 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.166215 Sep 15 00:46:28.329226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 156/316] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:28 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:28.415402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:28.423972 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-79188e23-5bf4-4bc1-b8be-2a6546a19a58 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1554 microversion: 2.1 time: 0.158993 Sep 15 00:46:28.424697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 161/317] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:28 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:28.598667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:28.599372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:28.605308 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:28.605786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:28.606254 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:28.607012 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:28.607472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:28.607929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:28.744456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:28.753284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0788d0dc-f041-4fc4-8d95-4724df477dac tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.159104 Sep 15 00:46:28.753942 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 157/318] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:28 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:29.351950 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:29.352516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:29.359071 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:29.359604 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:29.360064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:29.360806 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:29.361247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:29.361674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:29.446411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:29.447027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:29.456969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:29.457882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:29.458932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:29.460201 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:29.461182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:29.461834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:29.516387 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:29.524876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cbbb342e-31d5-4d22-9986-db93208090d1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.176773 Sep 15 00:46:29.533055 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 162/319] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:29 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:29.605483 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:29.614932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-638294d4-aa6f-49d1-9890-b18e9fc42901 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1554 microversion: 2.1 time: 0.172486 Sep 15 00:46:29.615576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 158/320] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:29 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:29.776815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:29.777432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:29.784030 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:29.784519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:29.784958 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:29.785655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:29.786115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:29.786543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:29.916664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:29.924222 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eeb47bbb-18bd-4199-8a8d-57a953d35e16 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.151312 Sep 15 00:46:29.924865 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 163/321] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:29 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:30.548637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:30.549175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:30.555623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:30.556101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:30.556532 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:30.557243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:30.557685 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:30.558102 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:30.638083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:30.638700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:30.644699 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:30.645188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:30.645630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:30.646336 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:30.646798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:30.647224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:30.688655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:30.696392 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f768336e-c59a-4417-9717-5d800351343c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.152073 Sep 15 00:46:30.696962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 159/322] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:30 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:30.773654 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:30.782212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9c5090d1-bd52-49b0-a840-221cb8e0da18 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1554 microversion: 2.1 time: 0.147962 Sep 15 00:46:30.782772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 164/323] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:30 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:30.945901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:30.946518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:30.952361 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:30.952839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:30.953275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:30.953961 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:30.954414 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:30.954836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:31.079079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:31.086649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-54e332ed-ad8c-4e82-8b2a-945bb31ced03 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.144506 Sep 15 00:46:31.087211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 160/324] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:30 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:31.717936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:31.718551 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:31.724505 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:31.724995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:31.725436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:31.726128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:31.726587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:31.727015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:31.804817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:31.805454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:31.812435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:31.812925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:31.813359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:31.814062 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:31.814518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:31.814944 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:31.859946 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:31.867573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-59797984-2354-4c2c-8e14-8e79c7c1749d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.153399 Sep 15 00:46:31.868131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 165/325] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:31 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:31.944292 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:31.952357 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d859aa05-ac7a-4367-86ed-94712cb61461 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1554 microversion: 2.1 time: 0.151447 Sep 15 00:46:31.952920 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 161/326] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:31 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:32.110276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:32.110897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:32.116850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:32.117340 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:32.117773 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:32.118462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:32.118918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:32.119342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:32.267781 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:32.275834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2cd0130e-73e9-4ce2-9a6f-3af5dc05df69 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.169847 Sep 15 00:46:32.291335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 166/327] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:32 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:32.892353 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:32.893717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:32.902832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:32.904093 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:32.904524 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:32.905225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:32.905674 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:32.906091 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:32.974903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:32.975724 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:32.983514 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:32.984168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:32.984938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:32.985954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:32.986523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:32.987040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:33.047287 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:33.054980 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d9fc3d77-2f5b-4c4b-919f-e34ca29d2d60 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.168674 Sep 15 00:46:33.055736 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 162/328] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:32 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:33.214656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:33.223610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-80b98f58-ce7c-41d1-8881-8d1e64856f4b tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1554 microversion: 2.1 time: 0.253120 Sep 15 00:46:33.224190 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 167/329] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:32 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:33.299304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:33.299976 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:33.311952 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:33.312823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:33.313240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:33.314422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:33.315044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:33.315467 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:33.493010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:33.503200 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-78230643-0620-493d-8c85-8b4fd57f849c tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1313 microversion: 2.1 time: 0.207619 Sep 15 00:46:33.520458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 163/330] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:33 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:34.080000 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:34.080844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:34.088068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:34.088994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:34.089508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:34.090293 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:34.090913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:34.091508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:34.237139 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:34.250260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:34.251865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:34.262482 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1b56faef-97c0-48de-9e58-b842c545cd2a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.188559 Sep 15 00:46:34.264264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:34.265080 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 168/331] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:34 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:34.265730 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:34.266396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:34.267363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:34.268079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:34.268799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:34.528698 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:34.529730 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:34.531978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=62 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:34.543875 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:34.545087 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:34.545929 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:34.550035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:34.551507 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:34.553238 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:34.680776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:34.696231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c4e4c820-7756-4a9f-9c7b-f3a67bfeaa82 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1554 microversion: 2.1 time: 0.450114 Sep 15 00:46:34.707553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 164/332] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:34 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1554 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:34.958086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:34.966328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-952729be-a7fa-49af-839e-cd0d69e6baf1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1497 microversion: 2.1 time: 0.442536 Sep 15 00:46:34.967188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 169/333] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:34 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1497 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:35.289840 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:35.290488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:35.305222 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:35.305727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:35.306161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:35.306872 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:35.307323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:35.307771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:35.722177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:35.730920 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9f5139fa-471e-4c6a-879d-b2f5e8dc68cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.446874 Sep 15 00:46:35.732758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:35.733398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:35.734088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 165/334] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:35 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:35.744882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:35.744882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:35.744882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:35.744882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:35.745472 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:35.745472 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:35.769896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:35.773418 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:35.789009 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:35.789506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:35.789943 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:35.790656 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:35.794154 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:35.796005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:35.835049 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:46:35.908210 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:35.954914 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b13f138b-7f63-46ad-87e5-e3cc53a99ba8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "DELETE /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 204 len: 0 microversion: 2.1 time: 0.193495 Sep 15 00:46:35.955712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 166/335] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:46:35 2022] DELETE /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:46:35.967234 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:35.969100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:35.978132 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:35.979344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:35.980018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:35.981029 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:35.981688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:35.982260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:36.181951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:36.194903 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a0927617-2812-492f-ac29-e1f181cd59aa tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1503 microversion: 2.1 time: 0.232083 Sep 15 00:46:36.208282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 167/336] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:35 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:36.344283 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:36.365947 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b3681ca1-b82a-4600-a84f-2a64f254be64 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1554 microversion: 2.1 time: 0.637475 Sep 15 00:46:36.366852 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-f53dbdbb-1ed5-4507-8a33-50188b3ff3ae req-3e4a9b56-dfd6-44e0-ae80-ec00383c577c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db3aac8-68f8-4028-8905-acb495f6ab89", "name": "network-vif-deleted", "tag": "60e67ba0-1a38-4c2c-8f3b-75d937cf69ec"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:36.368394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 170/337] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:35 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1554 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:36.378428 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f53dbdbb-1ed5-4507-8a33-50188b3ff3ae req-3e4a9b56-dfd6-44e0-ae80-ec00383c577c service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:36.378940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f53dbdbb-1ed5-4507-8a33-50188b3ff3ae req-3e4a9b56-dfd6-44e0-ae80-ec00383c577c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:36.379333 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f53dbdbb-1ed5-4507-8a33-50188b3ff3ae req-3e4a9b56-dfd6-44e0-ae80-ec00383c577c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:36.396856 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-f53dbdbb-1ed5-4507-8a33-50188b3ff3ae req-3e4a9b56-dfd6-44e0-ae80-ec00383c577c service nova] Creating event network-vif-deleted:60e67ba0-1a38-4c2c-8f3b-75d937cf69ec for instance 6db3aac8-68f8-4028-8905-acb495f6ab89 on hv-cinder-85752 Sep 15 00:46:36.402456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-f53dbdbb-1ed5-4507-8a33-50188b3ff3ae req-3e4a9b56-dfd6-44e0-ae80-ec00383c577c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041666 Sep 15 00:46:36.403045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 168/338] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:46:36.768870 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:36.769563 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:36.783136 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:36.783765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:36.784268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:36.785130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:36.785648 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:36.786912 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:37.105858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:37.140874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6fac5b29-181b-4fcf-ab68-db594e0817e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.376343 Sep 15 00:46:37.148946 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 171/339] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:36 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:37.225105 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:37.226327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:37.234048 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:37.235352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:37.236170 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:37.237421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:37.238838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:37.239860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:37.399374 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:37.400024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:37.414836 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:37.415419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:37.415789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:37.416501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:37.416957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:37.417382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:37.513277 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:37.522024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b70274f4-a16b-4016-a58c-a0faef5cc9c6 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1346 microversion: 2.1 time: 0.126365 Sep 15 00:46:37.522910 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 172/340] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:37 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:37.757865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:37.771566 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7c92ae4f-9edd-4995-9ce3-4728f4e91c91 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1503 microversion: 2.1 time: 0.551593 Sep 15 00:46:37.780558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 169/341] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:37 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1503 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:38.174440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:38.175052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:38.180997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:38.181487 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:38.181924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:38.182622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:38.183059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:38.183510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:38.342920 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1430954619", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "networks": [{"uuid": "a0341a54-b663-41cb-8fe1-4ffc2a77107e"}]}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:38.353673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:38.378633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:38.391620 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-93ead405-30f3-4f26-bdd5-193e179ba0bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.220823 Sep 15 00:46:38.407196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 173/342] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:38 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:38.432760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] validate_networks() for [('a0341a54-b663-41cb-8fe1-4ffc2a77107e', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:46:38.546879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:38.547742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:38.557130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:38.562684 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:38.563775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:38.564077 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:38.564540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:38.565003 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:38.889718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:38.920708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f2871cb5-08e4-4ec8-83e1-b466bdc80240 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1346 microversion: 2.1 time: 0.365923 Sep 15 00:46:38.929379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 174/343] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:38 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1346 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:38.940768 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:38.942643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:38.954294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:38.955015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:38.955444 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:38.957040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:38.958032 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:38.958618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:39.084137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:46:39.085162 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:46:39.085605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:46:39.086043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:46:39.086461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:46:39.101445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:39.101953 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:39.105400 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:39.106323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:39.106986 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:39.111332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:39.163832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Getting quotas for project 39a872cd1b1e451ba5786fe246950f73. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:46:39.170095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Getting quotas for user b8e4bda3331540d1a0b869270db9c25d and project 39a872cd1b1e451ba5786fe246950f73. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:46:39.186577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:46:39.189518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:46:39.256416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-326eefcf-ea6d-4ad9-8e8e-3218a0eefe57 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917817 Sep 15 00:46:39.268897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 170/344] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 00:46:39.274376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ec675708-9803-4b5c-8a76-4136f8e24d9a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:39.275013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ec675708-9803-4b5c-8a76-4136f8e24d9a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:39.328809 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:39.336675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:39.349982 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8bfceba9-ab88-4d9e-bbca-1445a6554968 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1503 microversion: 2.1 time: 0.419353 Sep 15 00:46:39.350496 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 175/345] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:38 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:39.415028 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:39.415686 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:39.426430 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:39.427203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:39.427904 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:39.429913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:39.430369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ec675708-9803-4b5c-8a76-4136f8e24d9a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:39.430829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:39.431413 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:39.450597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ec675708-9803-4b5c-8a76-4136f8e24d9a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1219 microversion: 2.1 time: 0.176975 Sep 15 00:46:39.456078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 171/346] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:39 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1219 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:39.729376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:39.740740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-57607144-a148-4b53-b851-c180b6aedbeb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.329265 Sep 15 00:46:39.741646 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 176/347] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:39 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:39.946374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:39.947059 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:39.955336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:39.956069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:39.956791 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:39.958063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:39.958731 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:39.961635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.000123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:40.000698 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:40.001205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.001908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lazy-loading 'fault' on Instance uuid 6db3aac8-68f8-4028-8905-acb495f6ab89 {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:46:40.078605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:40.089916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fd4bb39d-28b0-41f7-a967-139242ca6c81 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1351 microversion: 2.1 time: 0.147815 Sep 15 00:46:40.091097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 172/348] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:39 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:40.379473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:40.380464 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:40.392769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:40.393744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:40.394835 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.395960 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:40.396603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:40.397048 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.484825 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:40.485789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:40.497282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:40.499253 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:40.499921 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.500947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:40.502290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:40.502958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.665424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:40.669792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:40.676069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-326f1e0a-2954-4e0d-9ba5-b499248f48f0 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1503 microversion: 2.1 time: 0.302338 Sep 15 00:46:40.679697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 177/349] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:40 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1503 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:40.720461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ee64931e-5eea-462c-94f2-9c5b03a5a0d2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1215 microversion: 2.1 time: 0.241545 Sep 15 00:46:40.729183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 173/350] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:40 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:40.768651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:40.769916 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:40.779500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:40.780354 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:40.781383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.782372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:40.783242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:40.784175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-8a8f0cb6-ed90-45c1-87c0-3e638010d54d req-a4ad2936-c154-4976-9146-8b78ef5ed6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f02a2a-8587-4092-88f3-48cbdfc96193", "name": "network-vif-deleted", "tag": "1d459fdc-f5b1-4917-a5b5-eeb565ca4f6a"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:40.784364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.795160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-8a8f0cb6-ed90-45c1-87c0-3e638010d54d req-a4ad2936-c154-4976-9146-8b78ef5ed6a4 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:40.795667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-8a8f0cb6-ed90-45c1-87c0-3e638010d54d req-a4ad2936-c154-4976-9146-8b78ef5ed6a4 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:40.796263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-8a8f0cb6-ed90-45c1-87c0-3e638010d54d req-a4ad2936-c154-4976-9146-8b78ef5ed6a4 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:40.807671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-8a8f0cb6-ed90-45c1-87c0-3e638010d54d req-a4ad2936-c154-4976-9146-8b78ef5ed6a4 service nova] Creating event network-vif-deleted:1d459fdc-f5b1-4917-a5b5-eeb565ca4f6a for instance 30f02a2a-8587-4092-88f3-48cbdfc96193 on hv-cinder-85752 Sep 15 00:46:40.814171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-8a8f0cb6-ed90-45c1-87c0-3e638010d54d req-a4ad2936-c154-4976-9146-8b78ef5ed6a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033546 Sep 15 00:46:40.819801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 174/351] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:46:40.989039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:40.997589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0c5f99e5-7130-4fb6-9f03-b4327ace528c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1521 microversion: 2.1 time: 0.235230 Sep 15 00:46:40.998156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 178/352] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:40 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:41.113455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:41.114303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:41.120374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:41.120855 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:41.121592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:41.122593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:41.123230 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:41.123853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:41.162858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:41.163258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:41.163730 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:41.164175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lazy-loading 'fault' on Instance uuid 6db3aac8-68f8-4028-8905-acb495f6ab89 {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:46:41.217972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33070b58c99741eeb9f97a73507d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc126ea1c77342d091a96baf33bedf6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:41.226542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0273293a-ec8a-464d-a5e8-9026cdad17a8 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 200 len: 1351 microversion: 2.1 time: 0.117560 Sep 15 00:46:41.227120 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 175/353] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:41 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:41.700689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:41.701324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:41.707173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:41.707786 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:41.708230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:41.708925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:41.709383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:41.709811 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:41.749036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:41.749772 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:41.756593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:41.757167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:41.757667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:41.758435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:41.758959 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:41.759448 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:41.772431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:41.781571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-590db3de-66dd-4d32-b320-009aaf3d38f1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1298 microversion: 2.1 time: 0.084625 Sep 15 00:46:41.782254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 179/354] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:41 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:41.845991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:41.854550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-bfd02fe0-92b0-45c4-ad52-9be9488c42e7 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1271 microversion: 2.1 time: 0.109872 Sep 15 00:46:41.855288 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 176/355] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:41 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:42.021433 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:42.022089 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:42.028476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.028968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.029407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.030103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.030561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.030989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.167095 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:42.175443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e6739f61-5a29-4bf1-a090-60b3665d8151 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1501 microversion: 2.1 time: 0.157901 Sep 15 00:46:42.176033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 180/356] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:42 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:42.198201 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:42.198728 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:42.205348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.205894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.206341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.207053 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.207628 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.208153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.251359 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:42.252359 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:42.259525 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.260342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.261228 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.262212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.262956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.263659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.280801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] HTTP exception thrown: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Request method failure captured: Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 HTTP/1.1 Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV69_Xh-E_2kT7gFGTwtIao6m0eBgc4QRSkx1EaVot9OLucsRT64nD-lHNLaXqY3cXRCSzEv92MUhJnnD_BXD1tM32JfF3patXZX3Fxhcw3186QCGpnGs7QstkF0guaMPj00QDu0VqIExqwyedhhpjwL3GlAFmHpm3j145y2fsFf3k Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: bc126ea1c77342d091a96baf33bedf6e Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:46:42.285595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc126ea1c77342d091a96baf33bedf6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bc126ea1c77342d091a96baf33bedf6e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc126ea1c77342d091a96baf33bedf6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bc126ea1c77342d091a96baf33bedf6e"}]}] Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: bc126ea1c77342d091a96baf33bedf6e Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-DeleteServersTestJSON-1901845882-project Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 33070b58c99741eeb9f97a73507d012e Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-DeleteServersTestJSON-1901845882-project Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.287072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '6db3aac8-68f8-4028-8905-acb495f6ab89'} Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:46:42.288062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.289469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.290779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Returning 404 to user: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:46:42.290779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a052e41f-7347-47c0-8637-3226d8cc9214 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 404 len: 111 microversion: 2.1 time: 0.042512 Sep 15 00:46:42.292690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 181/357] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:42 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:46:42.391022 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:42.399887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d756effd-4204-4ffc-8b20-7b6730810456 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1516 microversion: 2.1 time: 0.205509 Sep 15 00:46:42.400548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 177/358] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:42 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1516 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:42.464406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:42.468084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:42.476340 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.476835 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.477505 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.478385 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.479039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.479831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.755934 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] HTTP exception thrown: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Request method failure captured: Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89/os-volume_attachments HTTP/1.1 Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV69_Xh-E_2kT7gFGTwtIao6m0eBgc4QRSkx1EaVot9OLucsRT64nD-lHNLaXqY3cXRCSzEv92MUhJnnD_BXD1tM32JfF3patXZX3Fxhcw3186QCGpnGs7QstkF0guaMPj00QDu0VqIExqwyedhhpjwL3GlAFmHpm3j145y2fsFf3k Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: bc126ea1c77342d091a96baf33bedf6e Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:46:42.763497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc126ea1c77342d091a96baf33bedf6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bc126ea1c77342d091a96baf33bedf6e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc126ea1c77342d091a96baf33bedf6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bc126ea1c77342d091a96baf33bedf6e"}]}] Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: bc126ea1c77342d091a96baf33bedf6e Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-DeleteServersTestJSON-1901845882-project Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 33070b58c99741eeb9f97a73507d012e Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-DeleteServersTestJSON-1901845882-project Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.765498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'server_id': '6db3aac8-68f8-4028-8905-acb495f6ab89'} Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:46:42.766252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:42.767560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:42.772211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Returning 404 to user: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:46:42.773150 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5e909b4b-55de-41ea-ae15-af9c8bfdeb7d tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.313275 Sep 15 00:46:42.774110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 182/359] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:46:42 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89/os-volume_attachments => generated 111 bytes in 315 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:46:42.829960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:42.830888 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:42.838052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.838486 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.841825 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.841825 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.841825 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.841825 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.879747 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.880224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:42.880717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:42.881245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.882027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.882904 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lazy-loading 'fault' on Instance uuid 30f02a2a-8587-4092-88f3-48cbdfc96193 {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:46:42.896894 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.899156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.900951 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.902485 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:42.906953 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:42.907717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:42.975393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:42.985312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c0ef8bbc-3b0c-44b5-99c1-3559b331cffb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 200 len: 1303 microversion: 2.1 time: 0.182460 Sep 15 00:46:42.985312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 178/360] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:42 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:43.026886 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:43.038326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cbd958d4-cbee-4853-be35-1900c79c1f2f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1277 microversion: 2.1 time: 0.161987 Sep 15 00:46:43.039239 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 183/361] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:42 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:44.009391 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:44.010111 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 30f02a2a-8587-4092-88f3-48cbdfc96193] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:44.018419 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.018984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.019634 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:44.020990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.021610 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.022192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:44.038597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] HTTP exception thrown: Instance 30f02a2a-8587-4092-88f3-48cbdfc96193 could not be found. Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Request method failure captured: Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 HTTP/1.1 Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInWaImG-zJilY8tNrciK6ArsgbpQa1zf5W6Wj8B_v7wTmChm31B3jL2bNKjw07jGgpX6watuYTo2jgsXWRAwXx_oMCeHszmoD1wx_i1I4diBf4w_wbg9EZsiKLhD2-7ZN2G65bYPndm-UC7JRR8xAcS7EifdwrTZDeX04E7mE4JS5bI Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 06a0252a4fba4f1ebfa9f25a2c6e39a4 Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesActionsTest-1389062041 Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:46:44.043800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/06a0252a4fba4f1ebfa9f25a2c6e39a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_06a0252a4fba4f1ebfa9f25a2c6e39a4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/06a0252a4fba4f1ebfa9f25a2c6e39a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/06a0252a4fba4f1ebfa9f25a2c6e39a4"}]}] Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesActionsTest-1389062041 Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 06a0252a4fba4f1ebfa9f25a2c6e39a4 Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesActionsTest-1389062041 Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesActionsTest-1389062041-project Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 5f294ab83780460f9679c7655c97a6e4 Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesActionsTest-1389062041-project Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 30f02a2a-8587-4092-88f3-48cbdfc96193 could not be found. Sep 15 00:46:44.045337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '30f02a2a-8587-4092-88f3-48cbdfc96193'} Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f02a2a-8587-4092-88f3-48cbdfc96193 could not be found. Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:46:44.046223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f02a2a-8587-4092-88f3-48cbdfc96193 could not be found. Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f02a2a-8587-4092-88f3-48cbdfc96193 could not be found. Sep 15 00:46:44.047454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:46:44.049444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Returning 404 to user: Instance 30f02a2a-8587-4092-88f3-48cbdfc96193 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:46:44.050470 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-81d9ab07-bedc-4552-a9f9-a27d78527035 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193" status: 404 len: 111 microversion: 2.1 time: 0.045220 Sep 15 00:46:44.051576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 179/362] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:44 2022] GET /compute/v2.1/servers/30f02a2a-8587-4092-88f3-48cbdfc96193 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:46:44.075331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:44.076131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:44.083845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.084613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.085236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:44.086145 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.087610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.088340 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:44.205432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-877129895", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "networks": [{"uuid": "7963b74a-c6e4-436d-bf68-47024742fd78"}]}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:44.317681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] validate_networks() for [('7963b74a-c6e4-436d-bf68-47024742fd78', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:46:44.360649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:44.374555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5d1a876e-d652-4307-bdc5-d86a1ac32eac tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.312228 Sep 15 00:46:44.390405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 184/363] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:44 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:44.397123 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:44.400797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:44.407697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.408329 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.409196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:44.410067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.410778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.411441 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:44.459528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lazy-loading 'flavor' on Instance uuid b40368c8-a515-46b7-add6-5db877d59406 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:46:44.582938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-374700e0-ffa7-4057-9eab-91ebc692a736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406/action" status: 200 len: 32 microversion: 2.1 time: 0.189719 Sep 15 00:46:44.584819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 185/364] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:46:44 2022] POST /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 00:46:44.598966 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-ffc8c74e-2584-41f5-82cf-8c4f029d6510 req-54d59091-f4f1-4e96-a0fa-1cca03532798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200f747f-85db-4561-aaaa-65b90c5c9f05", "tag": "8ad59f1e-2fde-43f8-a49d-a9e0b059c929"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:44.622758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-ffc8c74e-2584-41f5-82cf-8c4f029d6510 req-54d59091-f4f1-4e96-a0fa-1cca03532798 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.627067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-ffc8c74e-2584-41f5-82cf-8c4f029d6510 req-54d59091-f4f1-4e96-a0fa-1cca03532798 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.627609 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-ffc8c74e-2584-41f5-82cf-8c4f029d6510 req-54d59091-f4f1-4e96-a0fa-1cca03532798 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:44.644259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-ffc8c74e-2584-41f5-82cf-8c4f029d6510 req-54d59091-f4f1-4e96-a0fa-1cca03532798 service nova] Creating event network-changed:8ad59f1e-2fde-43f8-a49d-a9e0b059c929 for instance 200f747f-85db-4561-aaaa-65b90c5c9f05 on hv-cinder-85752 Sep 15 00:46:44.650927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-ffc8c74e-2584-41f5-82cf-8c4f029d6510 req-54d59091-f4f1-4e96-a0fa-1cca03532798 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064449 Sep 15 00:46:44.651792 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 186/365] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:46:44.658932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:44.659999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:44.689211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.692907 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.693378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:44.694127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:44.694595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:44.695204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.015139 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:45.024302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ca1a6d7a-44fe-4c82-929a-ca30c90c8f17 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.370922 Sep 15 00:46:45.025328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 187/366] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:44 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:45.312336 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:45.312985 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:45.318966 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:45.319471 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:45.319964 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.320668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:45.321129 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:45.321557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.336976 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] HTTP exception thrown: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Request method failure captured: Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 HTTP/1.1 Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV69_Xh-E_2kT7gFGTwtIao6m0eBgc4QRSkx1EaVot9OLucsRT64nD-lHNLaXqY3cXRCSzEv92MUhJnnD_BXD1tM32JfF3patXZX3Fxhcw3186QCGpnGs7QstkF0guaMPj00QDu0VqIExqwyedhhpjwL3GlAFmHpm3j145y2fsFf3k Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: bc126ea1c77342d091a96baf33bedf6e Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:46:45.338651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc126ea1c77342d091a96baf33bedf6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bc126ea1c77342d091a96baf33bedf6e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc126ea1c77342d091a96baf33bedf6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bc126ea1c77342d091a96baf33bedf6e"}]}] Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: bc126ea1c77342d091a96baf33bedf6e Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-DeleteServersTestJSON-1901845882-project Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 33070b58c99741eeb9f97a73507d012e Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-DeleteServersTestJSON-1901845882-project Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.339928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '6db3aac8-68f8-4028-8905-acb495f6ab89'} Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:46:45.340612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.341790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.342985 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Returning 404 to user: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:46:45.342985 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7b2e0870-a87e-4c9e-84f7-6d6ed368864f tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 404 len: 111 microversion: 2.1 time: 0.032131 Sep 15 00:46:45.344599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 188/367] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:46:45 2022] DELETE /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:46:45.349484 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:45.349667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] [instance: 6db3aac8-68f8-4028-8905-acb495f6ab89] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:45.355631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:45.356667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:45.357105 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.357988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:45.358458 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:45.358888 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.373563 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] HTTP exception thrown: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Request method failure captured: Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 HTTP/1.1 Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV69_Xh-E_2kT7gFGTwtIao6m0eBgc4QRSkx1EaVot9OLucsRT64nD-lHNLaXqY3cXRCSzEv92MUhJnnD_BXD1tM32JfF3patXZX3Fxhcw3186QCGpnGs7QstkF0guaMPj00QDu0VqIExqwyedhhpjwL3GlAFmHpm3j145y2fsFf3k Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: bc126ea1c77342d091a96baf33bedf6e Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:46:45.375246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc126ea1c77342d091a96baf33bedf6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bc126ea1c77342d091a96baf33bedf6e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc126ea1c77342d091a96baf33bedf6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bc126ea1c77342d091a96baf33bedf6e"}]}] Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: bc126ea1c77342d091a96baf33bedf6e Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-DeleteServersTestJSON-1901845882 Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-DeleteServersTestJSON-1901845882-project Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 33070b58c99741eeb9f97a73507d012e Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-DeleteServersTestJSON-1901845882-project Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.377254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '6db3aac8-68f8-4028-8905-acb495f6ab89'} Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:46:45.377943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. Sep 15 00:46:45.379177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:46:45.380479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] Returning 404 to user: Instance 6db3aac8-68f8-4028-8905-acb495f6ab89 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:46:45.380479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-daa73686-a6ed-4023-a131-7c070e879cc1 tempest-DeleteServersTestJSON-1901845882 tempest-DeleteServersTestJSON-1901845882-project] 10.222.0.15 "GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89" status: 404 len: 111 microversion: 2.1 time: 0.031681 Sep 15 00:46:45.380479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 189/368] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:45 2022] GET /compute/v2.1/servers/6db3aac8-68f8-4028-8905-acb495f6ab89 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:46:45.398418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:45.399162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:45.405380 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:45.405987 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:45.406494 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.407406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:45.407900 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:45.409674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.513963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:46:45.517148 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:46:45.518005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:46:45.518924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:46:45.519418 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:46:45.529208 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:45.529788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:45.530297 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.531112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:45.531672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:45.532172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:45.553105 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Getting quotas for project 06a0252a4fba4f1ebfa9f25a2c6e39a4. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:46:45.557255 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Getting quotas for user 5f294ab83780460f9679c7655c97a6e4 and project 06a0252a4fba4f1ebfa9f25a2c6e39a4. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:46:45.568471 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:45.569780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:46:45.572129 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:46:45.579754 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a241ae9a-5c5c-41ff-ba09-0e2b76ce105a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.185139 Sep 15 00:46:45.583528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 190/369] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:45 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:45.624563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3ad48d85-3b76-4585-9dcc-b6cf7a8bff21 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426332 Sep 15 00:46:45.625275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 180/370] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:46:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:46:45.636604 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-17b9dae9-fb58-415e-91f1-047f998d392f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:45.637268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-17b9dae9-fb58-415e-91f1-047f998d392f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:45.724281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-17b9dae9-fb58-415e-91f1-047f998d392f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:45.731472 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-17b9dae9-fb58-415e-91f1-047f998d392f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1213 microversion: 2.1 time: 0.098484 Sep 15 00:46:45.735536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 191/371] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:45 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:46.053278 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:46.053931 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:46.064821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:46.069151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:46.070119 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:46.070958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:46.071554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:46.072061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:46.329530 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:46.338310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-10062dd7-5b8e-42d5-9e19-150af649e290 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.291869 Sep 15 00:46:46.339552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 181/372] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:46 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:46.603258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:46.603963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:46.610885 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:46.611425 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:46.611908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:46.612709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:46.613225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:46.613673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:46.757489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:46.758215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:46.774200 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:46.774985 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:46.775434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:46.776195 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:46.776668 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:46.779948 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:46.784136 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:46.794258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9f624f40-0ea5-4b9c-ab7c-2eafbf693dce tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.194222 Sep 15 00:46:46.794837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 192/373] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:46 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:46.888383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:46.896227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3ad19ce9-2caa-46ac-80ba-1cf42c76f611 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1217 microversion: 2.1 time: 0.143369 Sep 15 00:46:46.896808 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 182/374] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:46 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:47.366470 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:47.367472 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:47.380902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:47.382143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:47.383245 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:47.384349 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:47.393577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:47.394573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:47.662352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:47.670583 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-abdb9bd5-2265-4edb-a82f-e354853fdb02 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.310202 Sep 15 00:46:47.671465 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 193/375] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:47 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:47.817859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:47.819156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:47.833824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:47.836422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:47.837063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:47.838133 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:47.838762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:47.839563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:47.919198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:47.919847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:47.933633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:47.934190 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:47.934641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:47.935365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:47.935936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:47.940012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:48.019123 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:48.022796 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:48.027351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e0bee2a2-da20-444c-b994-3bc350bd2f1b tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1217 microversion: 2.1 time: 0.111955 Sep 15 00:46:48.040037 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 194/376] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:47 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:48.087004 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:48.097401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-20d3fa4e-e6e0-4a6d-a4f0-2b4d203f547a tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.284501 Sep 15 00:46:48.112551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 183/377] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:47 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:48.694040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:48.694483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:48.705286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:48.706639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:48.707262 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:48.708332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:48.709083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:48.709720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:48.938771 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:48.951318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-598581e7-a5c9-486c-a1fc-c47a8ee1c532 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.261287 Sep 15 00:46:48.952805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 195/378] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:48 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:49.055658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:49.056516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:49.064522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:49.065042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:49.065555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:49.066268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:49.066723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:49.067146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:49.122305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:49.124018 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:49.133496 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:49.134066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:49.134602 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:49.135643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:49.136436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:49.137630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:49.222949 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:49.265303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ac8d680b-2401-4ab6-ad4c-ad8727c23b19 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1265 microversion: 2.1 time: 0.213608 Sep 15 00:46:49.268179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 184/379] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:49 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:49.603213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:49.618200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a3b77bf9-626b-4001-85d7-fe7b4b3d87db tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.495459 Sep 15 00:46:49.622038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 196/380] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:49 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:49.987893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:49.988509 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:49.995369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:49.995901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:49.996918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:49.997604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:50.003102 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:50.013361 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:50.296831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:50.297710 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:50.310162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:50.310703 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:50.311410 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:50.316719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:50.317234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:50.317691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:50.479435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:50.500004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-acbe2570-a546-4a83-8d67-887888ad0ec4 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1271 microversion: 2.1 time: 0.209281 Sep 15 00:46:50.501356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 197/381] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:50 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:50.510289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:50.530173 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a7d22096-1d93-4d95-8fa3-184214fbe95a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.547285 Sep 15 00:46:50.534779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 185/382] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:49 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:50.642802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:50.644462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:50.654744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:50.657367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:50.658188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:50.660123 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:50.660596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:50.661027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:50.962828 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:50.979343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8d3b8e57-a0a1-4f4c-9dee-81277c2c34c9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.340282 Sep 15 00:46:50.980210 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 198/383] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:50 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:51.532776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:51.535283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:51.546405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:51.547295 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:51.548601 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:51.549632 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:51.551361 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:51.552142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:51.556610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:51.557677 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:51.565782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:51.566644 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:51.567298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:51.568411 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:51.569131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:51.569921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:51.765585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:51.773402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:51.780512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6a82a97a-df65-4bbe-9233-b90a02632ddf tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.254667 Sep 15 00:46:51.784331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 186/384] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:51 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:52.003592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:52.004161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:52.010731 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:52.011226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:52.021259 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:52.022175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:52.022665 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:52.023105 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:52.133931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:52.174422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e6ec4172-94a6-40e2-9e64-cf94b5e6ab31 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.611941 Sep 15 00:46:52.175094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 199/385] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:51 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:52.196376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f2453b03-dc4b-40d0-a45b-dbd4f06a55a2 req-2d41d048-5d4a-44a1-8afc-f2f0edad69b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200f747f-85db-4561-aaaa-65b90c5c9f05", "name": "network-vif-plugged", "status": "completed", "tag": "8ad59f1e-2fde-43f8-a49d-a9e0b059c929"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:52.219819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f2453b03-dc4b-40d0-a45b-dbd4f06a55a2 req-2d41d048-5d4a-44a1-8afc-f2f0edad69b7 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:52.222470 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f2453b03-dc4b-40d0-a45b-dbd4f06a55a2 req-2d41d048-5d4a-44a1-8afc-f2f0edad69b7 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:52.224429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f2453b03-dc4b-40d0-a45b-dbd4f06a55a2 req-2d41d048-5d4a-44a1-8afc-f2f0edad69b7 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:52.265798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f2453b03-dc4b-40d0-a45b-dbd4f06a55a2 req-2d41d048-5d4a-44a1-8afc-f2f0edad69b7 service nova] Creating event network-vif-plugged:8ad59f1e-2fde-43f8-a49d-a9e0b059c929 for instance 200f747f-85db-4561-aaaa-65b90c5c9f05 on hv-cinder-85752 Sep 15 00:46:52.284066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f2453b03-dc4b-40d0-a45b-dbd4f06a55a2 req-2d41d048-5d4a-44a1-8afc-f2f0edad69b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085896 Sep 15 00:46:52.287131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 200/386] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:46:52.301463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-57470e1c-97a9-44b0-9c3a-d9f3fd63be9a req-a591d3c4-116b-4004-a050-6265f6551c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90bf6477-79b1-4c98-911f-25bda18dbba8", "tag": "71ae9dbc-3746-487e-9b8a-4f6e2e6cb6ad"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:52.323396 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-57470e1c-97a9-44b0-9c3a-d9f3fd63be9a req-a591d3c4-116b-4004-a050-6265f6551c49 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:52.326143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-57470e1c-97a9-44b0-9c3a-d9f3fd63be9a req-a591d3c4-116b-4004-a050-6265f6551c49 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:52.326960 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-57470e1c-97a9-44b0-9c3a-d9f3fd63be9a req-a591d3c4-116b-4004-a050-6265f6551c49 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:52.364814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-57470e1c-97a9-44b0-9c3a-d9f3fd63be9a req-a591d3c4-116b-4004-a050-6265f6551c49 service nova] Creating event network-changed:71ae9dbc-3746-487e-9b8a-4f6e2e6cb6ad for instance 90bf6477-79b1-4c98-911f-25bda18dbba8 on hv-cinder-85752 Sep 15 00:46:52.374641 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:52.375185 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-57470e1c-97a9-44b0-9c3a-d9f3fd63be9a req-a591d3c4-116b-4004-a050-6265f6551c49 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085277 Sep 15 00:46:52.376473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 201/387] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:46:52.385655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c6dd61e3-8e16-4a9f-a29c-6f4c8c04334c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.386405 Sep 15 00:46:52.389423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 187/388] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:51 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:52.809451 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:52.810159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:52.816593 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:52.817329 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:52.817770 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:52.818650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:52.819113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:52.819743 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:53.057491 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:53.077445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-08b9acc8-33f2-448d-af5e-9ba9d4ffdc5e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.272156 Sep 15 00:46:53.079232 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 202/389] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:52 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:53.197854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:53.198476 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:53.217250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:53.217778 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:53.218232 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:53.220347 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:53.220682 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:53.221637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:53.415012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:53.415899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:53.425678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:53.426510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:53.427166 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:53.428654 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:53.429492 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:53.430346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:53.528013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:53.554839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f9deb7d0-0493-4087-aff7-494b0cd69699 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.359660 Sep 15 00:46:53.555456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 188/390] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:53 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:53.628722 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:53.643690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a0d308be-db59-4b8d-afb8-43628f3dcb6e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.234770 Sep 15 00:46:53.644473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 203/391] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:53 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:54.100267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:54.100880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:54.108788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:54.109291 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:54.109733 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:54.110446 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:54.110919 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:54.111341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:54.289404 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:54.301217 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4562eab3-434c-4b21-9020-17c669686b46 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.204631 Sep 15 00:46:54.302393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 189/392] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:54 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:54.582782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:54.583396 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:54.590555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:54.591027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:54.591463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:54.592379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:54.592842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:54.593269 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:54.671576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:54.672419 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:54.680918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:54.681409 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:54.681845 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:54.682551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:54.683009 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:54.683439 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:54.874110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:54.882802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ca796706-d4ca-4d06-ac2d-42c1f9c470b9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.216089 Sep 15 00:46:54.883515 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 190/393] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:54 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:54.966810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:54.974557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0c7ff0e9-f449-45d7-b836-a045a1891255 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.395707 Sep 15 00:46:54.975296 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 204/394] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:54 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:55.326937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:55.327923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:55.335208 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:55.336058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:55.336759 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:55.337702 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:55.338404 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:55.339033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:55.540484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=4 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:55.566313 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=14 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:55.634205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:55.644267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-23827eda-a69c-4a23-aa13-08b37c706bf7 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.322739 Sep 15 00:46:55.660803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 191/395] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:55 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:55.906193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:55.906991 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:55.909132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:55.914486 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:55.915048 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:55.915728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:55.916658 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:55.917328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:55.917755 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:56.001821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:56.002771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:56.009141 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:56.009822 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:56.010289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:56.011167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:56.011917 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:56.012344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:56.142888 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:56.152735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-efef1f37-88c5-4f80-8067-56a88f2abfdb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.250300 Sep 15 00:46:56.155277 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 205/396] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:55 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:56.174382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:56.182587 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-25780665-4ca2-4245-9faf-e43a84d6c055 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.184773 Sep 15 00:46:56.199570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 192/397] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:55 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:46:56.668170 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:56.669596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:56.683244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:56.683939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:56.684494 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:56.685321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:56.687713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:56.688274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:56.925762 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:56.938746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c2e4d05b-5c15-481b-8d25-d1a817ffcfeb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.274476 Sep 15 00:46:56.940328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 206/398] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:56 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:57.181773 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:57.182395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:57.189273 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:57.190017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:57.190648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:57.191552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:57.192281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:57.192868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:57.207292 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:57.208073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:57.217640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:57.218306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:57.219963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:57.220837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:57.222420 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:57.225172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:57.469731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:57.479305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ad483b78-c4eb-4797-83eb-b7a870f5a087 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.275979 Sep 15 00:46:57.499651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 207/399] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:57 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:57.660073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:57.688676 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d3f30c09-9054-4e91-96d8-5bfe1cb3965d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.510622 Sep 15 00:46:57.693164 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 193/400] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:57 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:57.964279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:57.972167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-24a455f7-c064-4232-8683-5f4fe724a986 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'create', calling method: .version_select at 0x7f2f1e455280>, body: {"keypair": {"name": "tempest-keypair-560269850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASI/xk/bGxl33LUN617A/1Bujw5/ysa6ugwGd1t+WxfLHPlXYcL56VGi0L14RWY2HDX7Bms9Xc5ZdMORG56M4gre9sfLiwtMJ5dguhik1l0wfiHsgWM8CSm0cJf+L2KMA=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:46:57.972767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:57.984196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:57.984702 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:57.985144 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:57.986065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:57.987080 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:57.988138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:57.993118 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-24a455f7-c064-4232-8683-5f4fe724a986 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Getting quotas for project 72d7dfe402c045edbca04c0e7eee05f9. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:46:57.998550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-24a455f7-c064-4232-8683-5f4fe724a986 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Getting quotas for user 36e8e45674624c219b59abb39d8dcf83 and project 72d7dfe402c045edbca04c0e7eee05f9. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:46:58.031629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-24a455f7-c064-4232-8683-5f4fe724a986 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.231984 Sep 15 00:46:58.038653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 208/401] 10.222.0.15 () {62 vars in 1200 bytes} [Thu Sep 15 00:46:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 240 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 00:46:58.288020 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:58.297038 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a0973f37-2bec-4b51-aa80-4714582ca028 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.336485 Sep 15 00:46:58.297615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 194/402] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:57 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:58.513192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:58.513826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:58.529256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:58.530035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:58.530888 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:58.531790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:58.532562 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:58.533147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:58.720385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:58.722589 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:58.732999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:58.733737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:58.735357 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:58.736666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:58.737561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:58.739300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:58.785934 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:58.796404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d519aaf9-3c85-4278-8ca8-69857365839f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.292903 Sep 15 00:46:58.807540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 209/403] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:58 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:59.013609 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:59.022552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-74e0e939-754f-4ab3-9f9d-8f91dda5fa73 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.310079 Sep 15 00:46:59.023058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 195/404] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:58 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:59.321469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:59.322935 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:59.330077 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:59.330903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:59.331358 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:59.332415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:59.333118 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:59.333583 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:59.497958 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:46:59.506957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aa82e1a8-1756-4ffe-a531-3dad63b7f722 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.191097 Sep 15 00:46:59.508012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 210/405] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:59 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:46:59.825104 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:46:59.825745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:46:59.833177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:59.833872 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:59.834301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:46:59.835158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:46:59.835824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:46:59.836633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:00.045636 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:00.046607 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:00.055417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:00.056142 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:00.056930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:00.057977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:00.059132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:00.059945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:00.085472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:00.113106 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4f9b4e6c-01a1-4e28-a81a-f384aaf1ed87 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.293517 Sep 15 00:47:00.115554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 196/406] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:46:59 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:00.147440 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1024717113", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab876c33-1fa1-4628-a9be-d8dde255d344"}], "security_groups": [{"name": "tempest-securitygroup--57173474"}], "key_name": "tempest-keypair-560269850", "user_data": "}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:00.246879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:00.267606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-95785da9-34db-426c-88d5-f9efa4008e4d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.226193 Sep 15 00:47:00.268002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] validate_networks() for [('ab876c33-1fa1-4628-a9be-d8dde255d344', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:47:00.275588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 211/407] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:00 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:00.534735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:00.535401 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:00.544720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:00.545660 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:00.545948 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:00.546842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:00.547528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:00.547977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:00.711017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:00.721338 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e0adbb9f-a204-4f64-ad67-1be9ffca4021 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.194801 Sep 15 00:47:00.722151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 212/408] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:00 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:00.751494 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:47:00.751945 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:47:00.752424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:47:00.752831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:47:00.753270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:47:00.763807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:00.764297 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:00.764732 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:00.765464 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:00.766238 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:00.767326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:00.784340 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Getting quotas for project 72d7dfe402c045edbca04c0e7eee05f9. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:47:00.788363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Getting quotas for user 36e8e45674624c219b59abb39d8dcf83 and project 72d7dfe402c045edbca04c0e7eee05f9. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:47:00.790821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:00.801227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:47:00.803391 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:47:00.852705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b9f0f39e-c727-4071-98b4-67da721df6f9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.709919 Sep 15 00:47:00.854329 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 197/409] 10.222.0.15 () {62 vars in 1188 bytes} [Thu Sep 15 00:47:00 2022] POST /compute/v2.1/servers => generated 400 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 15 00:47:00.865257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cf03771d-4144-4ed0-af65-8fe9f5faf871 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:00.865873 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cf03771d-4144-4ed0-af65-8fe9f5faf871 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:00.868708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:00.924623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cf03771d-4144-4ed0-af65-8fe9f5faf871 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:00.931948 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cf03771d-4144-4ed0-af65-8fe9f5faf871 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:00.933924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cf03771d-4144-4ed0-af65-8fe9f5faf871 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:00.935040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cf03771d-4144-4ed0-af65-8fe9f5faf871 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1281 microversion: 2.20 time: 0.073614 Sep 15 00:47:00.937759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 213/410] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:00 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:01.140038 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:01.141239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:01.154228 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:01.154935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:01.155723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:01.157154 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:01.157592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:01.158498 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:01.290127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:01.290812 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:01.300825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:01.301339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:01.301783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:01.305271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:01.305793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:01.306228 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:01.369203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:01.383456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d5dacae0-1058-44aa-9df1-89c096df1dbe tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.248040 Sep 15 00:47:01.384561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 198/411] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:01 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:01.505552 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:01.509627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:01.515732 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1697cd7a-13f6-442c-9f34-4d49cfececab tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.229387 Sep 15 00:47:01.516314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 214/412] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:01 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:01.744254 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:01.745534 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:01.752468 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:01.752957 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:01.759225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:01.760017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:01.760484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:01.760912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:01.933391 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:01.942188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-55f2472a-7eef-45cd-8006-a5cfcd44729f tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.202375 Sep 15 00:47:01.942858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 199/413] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:01 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:01.963469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:01.965382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:01.973557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:01.974058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:01.974510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:01.975211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:01.975701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:01.976123 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:02.050471 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:02.060594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:02.062963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:02.064218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1d81fc32-56be-4ec4-ae17-37b273284d3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1285 microversion: 2.20 time: 0.105199 Sep 15 00:47:02.065025 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 215/414] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:01 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:02.413262 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:02.414161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:02.421166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:02.421655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:02.422278 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:02.422984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:02.423625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:02.424045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:02.539421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:02.540268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:02.551069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:02.555757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:02.556422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:02.557288 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:02.559128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:02.559706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:02.625166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:02.634958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2b858336-cc71-4c6b-a855-55fd8a952c50 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.226845 Sep 15 00:47:02.635621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 200/415] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:02 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:02.718876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:02.727600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-638b4c4e-e954-4fc1-b658-3c5ec6bf5d7d tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1319 microversion: 2.1 time: 0.192722 Sep 15 00:47:02.728216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 216/416] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:02 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:02.966254 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:02.967703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:02.974531 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:02.975273 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:02.975890 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:02.976809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:02.977445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:02.978022 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:03.090377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:03.091501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:03.097512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:03.098163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:03.098751 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:03.099655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:03.100513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:03.101079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:03.122454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:03.130556 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c77d5180-b59f-4602-96ea-c976012749d1 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.168998 Sep 15 00:47:03.131147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 201/417] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:02 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:03.165731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:03.175644 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:03.176015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:03.177101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-12059106-984b-4feb-a103-1f0c3ab66a89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1277 microversion: 2.20 time: 0.091045 Sep 15 00:47:03.177651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 217/418] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:03 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:03.658686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:03.659298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:03.665299 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:03.665785 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:03.666238 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:03.666913 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:03.667368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:03.667865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:03.752152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:03.753162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:03.760966 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:03.762247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:03.762869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:03.763762 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:03.764381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:03.764807 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:03.820925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:03.829772 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8f228118-b09e-4ef0-9cfb-e3703744e736 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.174921 Sep 15 00:47:03.830398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 202/419] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:03 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:04.148586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:04.152817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:04.153531 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:04.156338 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f8da4a75-1899-44b9-8051-5778c9d56c8b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1509 microversion: 2.1 time: 0.409414 Sep 15 00:47:04.156907 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 218/420] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:03 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:04.171579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:04.171579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:04.171579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:04.171579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:04.172622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:04.172622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:04.205414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:04.217169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:04.224143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:04.224988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:04.225439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:04.226156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:04.226988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:04.227610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:04.329831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:04.331397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:04.339022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:04.341035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:04.341578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-dcc08207-17a6-4120-a28d-565e3f331e2d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.192351 Sep 15 00:47:04.342182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 203/421] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:04 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:04.342713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ccfa985f-3c35-45ab-8935-647456b56938 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1333 microversion: 2.20 time: 0.144214 Sep 15 00:47:04.343866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 219/422] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:04 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:04.853396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:04.854193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:04.861177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:04.861671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:04.862111 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:04.863211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:04.863860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:04.864480 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:04.869158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:05.026023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:05.036061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4e8431dd-c4ed-4852-a622-e47fd951e9c3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.186914 Sep 15 00:47:05.037005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 204/423] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:04 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:05.064584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-78e7dd44-aa12-4528-8b01-1d6be0043578 req-08a5f123-e43b-4fc4-96ab-ee89349b7dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90bf6477-79b1-4c98-911f-25bda18dbba8", "name": "network-vif-plugged", "status": "completed", "tag": "71ae9dbc-3746-487e-9b8a-4f6e2e6cb6ad"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:05.075304 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-78e7dd44-aa12-4528-8b01-1d6be0043578 req-08a5f123-e43b-4fc4-96ab-ee89349b7dbf service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:05.075992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-78e7dd44-aa12-4528-8b01-1d6be0043578 req-08a5f123-e43b-4fc4-96ab-ee89349b7dbf service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:05.076469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-78e7dd44-aa12-4528-8b01-1d6be0043578 req-08a5f123-e43b-4fc4-96ab-ee89349b7dbf service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:05.089049 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-78e7dd44-aa12-4528-8b01-1d6be0043578 req-08a5f123-e43b-4fc4-96ab-ee89349b7dbf service nova] Creating event network-vif-plugged:71ae9dbc-3746-487e-9b8a-4f6e2e6cb6ad for instance 90bf6477-79b1-4c98-911f-25bda18dbba8 on hv-cinder-85752 Sep 15 00:47:05.095922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-78e7dd44-aa12-4528-8b01-1d6be0043578 req-08a5f123-e43b-4fc4-96ab-ee89349b7dbf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035450 Sep 15 00:47:05.096803 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 220/424] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:47:05.366570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:05.368076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:05.370874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:05.372452 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:05.376537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:05.377362 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:05.378351 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:05.379868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:05.381114 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:05.381534 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:05.381869 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:05.382371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:05.382978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:05.384214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:05.384941 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:05.385355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:05.455819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:05.467023 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:05.469004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:05.470297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bf007be3-2b7d-45cc-96cf-bfbc5d1a9418 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1341 microversion: 2.20 time: 0.105081 Sep 15 00:47:05.471193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 221/425] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:05 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1341 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:05.547248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:05.561484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-03febf7e-d80b-4373-84a7-563c17cf0119 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.199909 Sep 15 00:47:05.562358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 205/426] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:05 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:06.060879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:06.061759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:06.068235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:06.068662 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:06.069025 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:06.070439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:06.070891 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:06.071516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:06.259076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:06.267918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aa6625bb-e234-4181-a710-5a96740568a9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.211734 Sep 15 00:47:06.268587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 222/427] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:06 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:06.495851 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:06.496482 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:06.503917 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:06.504414 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:06.505098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:06.505816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:06.506268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:06.506696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:06.577987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:06.585114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:06.585733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:06.586768 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:06.588253 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:06.589357 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d80a1df0-32b7-4fa2-a6fb-647a542352e1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1341 microversion: 2.20 time: 0.097605 Sep 15 00:47:06.590272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 206/428] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:06 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:06.592156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:06.592647 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:06.593089 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:06.593793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:06.594256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:06.594685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:06.729998 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:06.738659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d15aaa4f-b047-4c14-8a74-d27d3d532241 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.157255 Sep 15 00:47:06.739237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 223/429] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:06 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:07.292527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:07.293186 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:07.299823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:07.300314 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:07.300758 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:07.301465 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:07.301923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:07.302353 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:07.542608 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:07.550245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-02284ab3-6b96-40d0-8455-ce07f1853874 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.261680 Sep 15 00:47:07.550816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 207/430] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:07 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:07.615194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:07.615896 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:07.623334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:07.623857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:07.624292 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:07.624998 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:07.625456 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:07.625925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:07.692078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:07.702167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:07.703688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:07.704795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-76877afb-cefe-47e5-8398-5cfc7a607e9b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1339 microversion: 2.20 time: 0.094039 Sep 15 00:47:07.705356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 224/431] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:07 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:07.763154 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:07.763886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:07.770640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:07.771203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:07.771665 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:07.772368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:07.772903 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:07.773409 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:07.972952 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:07.981337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-474e429f-c2ca-49d5-a1bd-96b74627dbd8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.222695 Sep 15 00:47:07.981908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 208/432] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:07 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:08.573032 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:08.573641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:08.579592 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:08.580085 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:08.580719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:08.581415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:08.581877 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:08.582300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:08.730728 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:08.732129 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:08.746098 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:08.748889 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:08.749541 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:08.750478 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:08.752004 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:08.752802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:08.753538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:08.759168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e9a1ff26-c7a6-4cd3-a446-419ea6fe9f64 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.190018 Sep 15 00:47:08.760126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 225/433] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:08 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:09.004013 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:09.004574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:09.010899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:09.011391 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:09.011855 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:09.013054 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:09.013512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:09.013941 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:09.049231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:09.057572 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:09.059020 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:09.060442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a9dd6e2b-7088-4af1-bf63-a21f4eb4a5c6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.333807 Sep 15 00:47:09.061209 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 209/434] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:08 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:09.152636 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:09.161336 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d687f232-4ae3-42bd-a4e9-7331c4e6e571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.161247 Sep 15 00:47:09.162231 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 226/435] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:08 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:09.467071 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-fa9d788e-c9f8-4fed-85c3-eb1237bececa req-73b17c9d-6f11-4fc4-b96c-7fc3c9f457ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "469fcc1e-0231-4642-b72f-c2bf7fd7eb07", "tag": "86077b58-abc6-43a7-9b01-51a893794c4e"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:09.483648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-fa9d788e-c9f8-4fed-85c3-eb1237bececa req-73b17c9d-6f11-4fc4-b96c-7fc3c9f457ed service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:09.483648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-fa9d788e-c9f8-4fed-85c3-eb1237bececa req-73b17c9d-6f11-4fc4-b96c-7fc3c9f457ed service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:09.483648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-fa9d788e-c9f8-4fed-85c3-eb1237bececa req-73b17c9d-6f11-4fc4-b96c-7fc3c9f457ed service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:09.494421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-fa9d788e-c9f8-4fed-85c3-eb1237bececa req-73b17c9d-6f11-4fc4-b96c-7fc3c9f457ed service nova] Creating event network-changed:86077b58-abc6-43a7-9b01-51a893794c4e for instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 on hv-cinder-85752 Sep 15 00:47:09.500680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-fa9d788e-c9f8-4fed-85c3-eb1237bececa req-73b17c9d-6f11-4fc4-b96c-7fc3c9f457ed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037356 Sep 15 00:47:09.501379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 210/436] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:47:09.784212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:09.784758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:09.790713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:09.791199 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:09.791676 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:09.792375 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:09.792837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:09.793264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:09.929229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:09.937641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e06bce7d-260b-436c-9af2-5713a7c6128c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1502 microversion: 2.1 time: 0.157323 Sep 15 00:47:09.938208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 227/437] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:09 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:09.962103 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c233783d-4321-4b70-b1dc-070833345a63"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:09.964840 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:09.971650 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:09.972140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:09.972636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:09.973369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:09.973820 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:09.974242 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:09.998193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] HTTP exception thrown: Cannot 'attach_volume' instance b40368c8-a515-46b7-add6-5db877d59406 while it is in vm_state rescued Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Request method failure captured: Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: POST /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406/os-volume_attachments HTTP/1.1 Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 74 Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInV5eOfxwz_L73XdSLZWs9muQNY38kG-uSkSdNdD8kYJGR4XiNtFxq0Biq3TCHGtX13rOTtMlS0D_4QILbpyxnJYCKqG4JBVLvzkCUnjXpiqmwovyYFBWquCXGGjip-3VBu43caF28c5uwRoM3euCFhr7Swgrcz6Ragt_7hg-yuoFig Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:47:09.999884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7090f91f78534107ba4b5ccd7f80e145", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7090f91f78534107ba4b5ccd7f80e145"}]}] Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 4e0e6a33679f4cac96704f71dcfa5c01 Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {"volumeAttachment": {"volumeId": "c233783d-4321-4b70-b1dc-070833345a63"}} Sep 15 00:47:10.002382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Cannot 'attach_volume' instance b40368c8-a515-46b7-add6-5db877d59406 while it is in vm_state rescued Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'server_id': 'b40368c8-a515-46b7-add6-5db877d59406', 'body': {'volumeAttachment': {'volumeId': 'c233783d-4321-4b70-b1dc-070833345a63'}}} Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b40368c8-a515-46b7-add6-5db877d59406 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:47:10.005130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b40368c8-a515-46b7-add6-5db877d59406 while it is in vm_state rescued Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:47:10.008036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:47:10.010611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:47:10.010611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:47:10.010611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b40368c8-a515-46b7-add6-5db877d59406 while it is in vm_state rescued Sep 15 00:47:10.010611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:10.010611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Returning 409 to user: Cannot 'attach_volume' instance b40368c8-a515-46b7-add6-5db877d59406 while it is in vm_state rescued {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:47:10.010611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8cab9489-fb33-4533-b071-0614288cb2cf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043695 Sep 15 00:47:10.010611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 211/438] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:47:09 2022] POST /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 15 00:47:10.015782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:10.016322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:10.022489 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:10.022986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:10.023425 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:10.024158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:10.024626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:10.025167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:10.086243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:10.086893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:10.092069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8e3f0171-0d8c-4147-b933-b0959e6b4e7c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406/action" status: 202 len: 0 microversion: 2.1 time: 0.082128 Sep 15 00:47:10.095889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 228/439] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:47:10 2022] POST /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:47:10.096018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:10.096018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:10.096018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:10.096018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:10.096351 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:10.096351 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:10.101407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:10.102095 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:10.109590 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:10.110093 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:10.110537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:10.111258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:10.111748 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:10.112181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:10.231787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:10.239920 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:10.241462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:10.242570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-501622d8-4d48-42e2-975d-d3b0312fa154 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.160343 Sep 15 00:47:10.243125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 212/440] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:10 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:10.247623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:10.248237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:10.251226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:10.254454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:10.255257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:10.255772 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:10.256590 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:10.257101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:10.257703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:10.259704 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7d5ab32d-814d-44ac-be71-ed716336a4c5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.162424 Sep 15 00:47:10.261715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 229/441] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:10 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:10.388396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:10.395976 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-784a4326-897a-4ae7-bd36-802b056ab754 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.151817 Sep 15 00:47:10.396536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 213/442] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:10 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:11.268369 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:11.268902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:11.270933 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:11.276526 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:11.277020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:11.277463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:11.278193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:11.278667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:11.279091 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:11.282246 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:11.282871 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:11.284914 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:11.285641 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=6 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:11.292912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:11.293906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:11.294350 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:11.295067 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:11.295548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:11.295990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:11.418010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:11.426719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:11.428213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:11.429325 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5c0c719c-d216-4772-bc95-895c7cb428cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.164956 Sep 15 00:47:11.432135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 230/443] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:11 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:11.432319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:11.437586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:11.438319 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:11.440582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2b540300-695b-40cf-ac4f-287948633097 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.162210 Sep 15 00:47:11.441282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 214/444] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:11 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:11.444493 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:11.444980 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:11.445415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:11.446109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:11.446602 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:11.447027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:11.450908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:11.574566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:11.582055 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5cf08de0-19b1-4f21-8914-8e3c20067bc6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.148778 Sep 15 00:47:11.582612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 231/445] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:11 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:12.459101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:12.459812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:12.464805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:12.465446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:12.466298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:12.466777 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:12.467208 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:12.467940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:12.468393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:12.468813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:12.471260 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:12.471784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:12.472226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:12.472925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:12.473384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:12.473817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:12.607959 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:12.609387 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:12.616332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:12.617367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-63587d44-3b73-4b46-b244-273fc02d6dfc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.156400 Sep 15 00:47:12.617782 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:12.618141 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 232/446] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:12 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:12.618947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1b63cb22-d2de-4e46-9b28-8e3239b22f64 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.163723 Sep 15 00:47:12.619440 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 215/447] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:12 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:12.623175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:12.623876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:12.630334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:12.630879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:12.631309 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:12.632233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:12.632676 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:12.633097 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:12.761850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:12.769697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0acc04c4-f08d-4fd0-b10a-08e1eeea96d6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.150569 Sep 15 00:47:12.770453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 233/448] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:12 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:13.644210 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:13.644635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:13.644987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:13.645172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:13.651859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:13.652062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:13.652278 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:13.653305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:13.653461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:13.653949 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:13.654073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:13.654488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:13.654711 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:13.654938 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:13.655431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:13.655945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:13.784207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:13.788641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:13.792126 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9751595c-bcf1-4f54-a8aa-b497487f04a8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.151721 Sep 15 00:47:13.792700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 216/449] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:13 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:13.801682 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:13.801821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:13.801920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:13.802013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:13.802094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-607fdae7-9682-48dc-a220-9d27236f7345 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.159221 Sep 15 00:47:13.802094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 234/450] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:13 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:13.805065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:13.805553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:13.805991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:13.806689 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:13.807147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:13.807605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:13.943672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:13.953115 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-38f5ebf5-cb7b-4502-a261-dfd1aa48b7d3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.158505 Sep 15 00:47:13.953683 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 217/451] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:13 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:14.815199 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:14.815831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:14.821947 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:14.822435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:14.822872 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:14.823600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:14.824059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:14.824680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:14.825104 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:14.825289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:14.831779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:14.832265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:14.832698 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:14.833397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:14.833848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:14.834263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:14.959179 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:14.969402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:14.970269 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-65ca45b5-c6dc-4b9b-82fb-0efa9decd962 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.158763 Sep 15 00:47:14.976168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 235/452] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:14 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:14.978930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:14.981354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:14.983082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-15bf9992-7bfc-49ef-95dc-39bd09e041b4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.162265 Sep 15 00:47:14.983944 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 218/453] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:14 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:14.984157 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:14.984896 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:14.990890 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:14.991380 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:14.991846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:14.992550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:14.993004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:14.993429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:15.120411 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:15.128220 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7534c68c-9660-4f3a-9229-34e65527cfbb tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.150914 Sep 15 00:47:15.128788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 236/454] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:14 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:15.993809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:15.994416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:16.001456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:16.001934 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:16.002366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:16.003055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:16.003602 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:16.004027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:16.013443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:16.014059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:16.020074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:16.020562 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:16.021003 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:16.021698 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:16.022153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:16.022576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:16.131233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:16.138947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0c2859ea-a4e7-4765-800e-1bcf1e9fa9e2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.148927 Sep 15 00:47:16.139743 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 219/455] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:15 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:16.151396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:16.152160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:16.156001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:16.158648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:16.159141 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:16.159612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:16.160310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:16.160764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:16.161188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:16.164389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:16.165996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:16.167146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2ae57011-4038-4043-8c22-85aaa9ce13fa tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.157468 Sep 15 00:47:16.168003 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 237/456] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:16 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:16.298708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:16.306362 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-bce86321-9d2d-47f8-8bce-19ed54f2b6db tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1313 microversion: 2.1 time: 0.158726 Sep 15 00:47:16.306926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 220/457] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:16 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:17.163017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:17.164066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:17.170110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:17.170594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:17.171027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:17.171777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:17.172231 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:17.172655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:17.192671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:17.193844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:17.201704 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:17.202563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:17.203229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:17.204151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:17.204633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:17.205343 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:17.354097 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:17.362408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a45d8759-b642-4aaf-a6cf-9d5e9ab3ddfb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.204004 Sep 15 00:47:17.362975 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 238/458] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:17 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:17.376916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:17.377690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:17.378483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:17.382117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:17.385208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:17.385698 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:17.386135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:17.386839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:17.387294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:17.387903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:17.388667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:17.390264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:17.391589 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-22b11e0a-5658-4ef7-a0b3-62a97c75d55d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.203039 Sep 15 00:47:17.392142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 221/459] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:17 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:17.517261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:17.524892 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a43d6a66-e239-4b3c-8e20-4acdabfd2571 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1497 microversion: 2.1 time: 0.156355 Sep 15 00:47:17.525457 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 239/460] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:17 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:18.386261 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:18.386875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:18.395063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:18.395580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:18.396494 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:18.397370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:18.397834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:18.398263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:18.416267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:18.416891 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:18.422952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:18.423473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:18.423956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:18.424723 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:18.425288 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:18.425756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:18.536791 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:18.544597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5125438d-75c4-4976-8dad-22989490838e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.162060 Sep 15 00:47:18.545150 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 222/461] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:18 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:18.557016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:18.565648 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:18.567090 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:18.568220 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5744ee26-bb07-41b7-b9f7-b933a4fbbb89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.155839 Sep 15 00:47:18.568772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 240/462] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:18 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:19.568069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:19.568674 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:19.575280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:19.575802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:19.576724 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:19.577420 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:19.577901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:19.578325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:19.594013 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:19.594628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:19.600481 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:19.600974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:19.601415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:19.602120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:19.602578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:19.603005 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:19.708761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:19.716401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-05265145-a678-456a-8235-9faa73e848af tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.152171 Sep 15 00:47:19.717499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 223/463] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:19 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:19.731127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:19.739341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:19.740852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:19.741954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-caa370ee-19d0-496f-ab5d-587a64a1e52f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.152433 Sep 15 00:47:19.742500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 241/464] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:19 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:19.992694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:19.993184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:19.999470 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:19.999980 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:20.000411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:20.001093 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:20.001545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:20.001967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:20.028469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:47:20.104394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f0b590e2-4855-492a-bbd5-e2db9680a3c6 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "DELETE /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 204 len: 0 microversion: 2.1 time: 0.115338 Sep 15 00:47:20.104964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 224/465] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:47:19 2022] DELETE /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:47:20.113145 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:20.113759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:20.119937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:20.120418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:20.120852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:20.121539 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:20.121988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:20.122409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:20.254891 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:20.262582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e6b7e503-ab5e-407f-a0a8-c62beabed6a8 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.153394 Sep 15 00:47:20.263450 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 242/466] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:20 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:20.741582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:20.742244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:20.748998 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:20.749489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:20.749925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:20.750630 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:20.751084 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:20.751530 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:20.767173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:20.768760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:20.774931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:20.775510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:20.776019 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:20.776735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:20.777195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:20.777624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:20.889929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:20.897941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-38f5bd7c-6ae2-4154-93a7-bb8a39c682bf tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.160566 Sep 15 00:47:20.898508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 225/467] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:20 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:20.977985 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:20.986567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:20.988108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:20.989308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b431e9b0-65e8-4ffb-9dc7-ca93bcb3bc72 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.227007 Sep 15 00:47:20.989947 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 243/468] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:20 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:21.286912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:21.287563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:21.294190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:21.294684 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:21.295123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:21.296032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:21.296499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:21.296925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:21.445899 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:21.454368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-13e11274-8ed1-4fde-9efe-66db5d481267 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.171544 Sep 15 00:47:21.455019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 226/469] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:21 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:21.922045 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:21.922660 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:21.929161 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:21.929797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:21.930297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:21.931070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:21.931549 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:21.931977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:22.018860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:22.019397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:22.025605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:22.026085 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:22.026516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:22.027214 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:22.027705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:22.028125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:22.129063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:22.139365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cc0cbc66-ab94-40d7-9b69-04e8be63c51b tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.221721 Sep 15 00:47:22.139996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 244/470] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:21 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:22.200380 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:22.208482 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:22.209947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:22.211050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-25cfd0ae-47d8-4519-94bc-d4afcc6f883e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.196200 Sep 15 00:47:22.211622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 227/471] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:22 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:22.477634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:22.478276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:22.484213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:22.484719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:22.485168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:22.485893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:22.486347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:22.486767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:22.640550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:22.651221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-39d864a3-72c6-4421-9c51-5cc011f69951 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.177321 Sep 15 00:47:22.651837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 245/472] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:22 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:23.161990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:23.162603 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:23.169002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:23.169477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:23.170397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:23.171082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:23.171552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:23.171975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:23.237582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:23.238243 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:23.245273 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:23.245771 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:23.246229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:23.246947 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:23.247606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:23.248656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:23.408879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:23.425090 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:23.426815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:23.427847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-199daa7d-a95d-4a1e-9ac4-400df82496f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.194271 Sep 15 00:47:23.428404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 246/473] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:23 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:23.573956 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:23.581993 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2dd5eabf-c218-42b6-a881-e91da656c5bc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.423730 Sep 15 00:47:23.582836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 228/474] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:23 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:23.678267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:23.679848 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:23.687303 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:23.688003 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:23.688440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:23.689593 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:23.690743 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:23.691175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:23.822748 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:23.826107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:23.830678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-48f369c7-6101-4d7c-b698-8a3926952a89 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.158115 Sep 15 00:47:23.831254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 247/475] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:23 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:24.455818 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:24.456425 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:24.462788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:24.463267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:24.463741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:24.464428 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:24.464878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:24.465302 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:24.597527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:24.606740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:24.607580 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:24.610803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:24.612304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:24.613422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e2655c20-83a6-41bd-b0ef-d7326b1f2a42 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.162277 Sep 15 00:47:24.613875 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:24.613986 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 229/476] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:24 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:24.614377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:24.614818 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:24.615553 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:24.616018 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:24.616453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:24.748882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:24.757415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a01af9fa-15ac-4fe1-a9d6-06098e830bb2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.154906 Sep 15 00:47:24.758006 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 248/477] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:24 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:24.853779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:24.854391 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:24.860864 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:24.861352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:24.861789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:24.862487 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:24.862943 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:24.863371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:24.988085 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:24.996649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e0b1c21f-f070-4789-b5b8-5477a75dff8e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.146674 Sep 15 00:47:24.997341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 230/478] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:24 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:25.640263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:25.640877 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:25.646967 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:25.647465 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:25.647922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:25.648630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:25.649075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:25.649502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:25.781313 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:25.781922 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:25.789667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:25.791695 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:25.792153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:25.792876 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:25.793278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:25.793400 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:25.793756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:25.803139 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:25.805258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:25.806869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-39eb2912-a71a-4f53-bd79-06760c052cc1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.170918 Sep 15 00:47:25.807923 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 249/479] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:25 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:25.952902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:25.961273 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fdd5a53d-9e9f-425f-82d7-ae6b3a8f8c29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.184891 Sep 15 00:47:25.961854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 231/480] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:25 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:26.021053 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:26.021882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:26.027913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:26.028404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:26.029030 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:26.029927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:26.030667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:26.031258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:26.177515 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:26.185214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-153d847b-ba27-4c3a-a4bc-058ab59b919e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.168465 Sep 15 00:47:26.186404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 250/481] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:26 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:26.836087 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:26.836695 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:26.843454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:26.843972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:26.844405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:26.845105 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:26.845558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:26.845982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:26.983860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:26.984470 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:26.990223 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:26.990710 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:26.991147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:26.991865 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:26.992321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:26.992755 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:27.007433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:27.016232 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:27.017664 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:27.018759 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-86d7e9ae-0a95-4f42-a4c8-604bd6fe91d6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.186604 Sep 15 00:47:27.019313 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 232/482] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:26 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:27.127992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:27.136709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7c370253-46a8-4bd4-a093-9b99903b4aa5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1510 microversion: 2.1 time: 0.156592 Sep 15 00:47:27.137454 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 251/483] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:26 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:27.209213 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:27.210591 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:27.211413 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-de7adfe9-7268-4a50-bede-56714bdd7c5e req-75820e69-d483-4c2d-b085-e75abd1352f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "469fcc1e-0231-4642-b72f-c2bf7fd7eb07", "name": "network-vif-plugged", "status": "completed", "tag": "86077b58-abc6-43a7-9b01-51a893794c4e"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:27.217656 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:27.218678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:27.219468 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:27.221117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:27.221832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:27.222638 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:27.225035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-de7adfe9-7268-4a50-bede-56714bdd7c5e req-75820e69-d483-4c2d-b085-e75abd1352f3 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:27.225854 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-de7adfe9-7268-4a50-bede-56714bdd7c5e req-75820e69-d483-4c2d-b085-e75abd1352f3 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:27.226480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-de7adfe9-7268-4a50-bede-56714bdd7c5e req-75820e69-d483-4c2d-b085-e75abd1352f3 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:27.244245 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-de7adfe9-7268-4a50-bede-56714bdd7c5e req-75820e69-d483-4c2d-b085-e75abd1352f3 service nova] Creating event network-vif-plugged:86077b58-abc6-43a7-9b01-51a893794c4e for instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 on hv-cinder-85752 Sep 15 00:47:27.250652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-de7adfe9-7268-4a50-bede-56714bdd7c5e req-75820e69-d483-4c2d-b085-e75abd1352f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043913 Sep 15 00:47:27.252197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 252/484] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:47:27.381705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:27.389542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1e92ee5b-8851-4afe-bf86-128eac8b1351 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.184527 Sep 15 00:47:27.390099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 233/485] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:27 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:28.044365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:28.045065 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:28.051067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:28.051591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:28.052035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:28.052728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:28.053246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:28.053674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:28.160403 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:28.161068 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:28.167457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:28.167970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:28.168402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:28.169095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:28.169545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:28.169967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:28.182646 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:28.191298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:28.192772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:28.193896 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7d82d7c4-8006-4048-ad63-c6df0e14a278 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.153846 Sep 15 00:47:28.194453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 253/486] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:28 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:47:28.304819 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:28.313042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e9f30f1e-5f93-4348-9c56-99baf4ed82e8 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1516 microversion: 2.1 time: 0.156553 Sep 15 00:47:28.313707 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 234/487] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:28 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:28.413009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:28.413688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:28.420264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:28.420756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:28.421195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:28.421899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:28.422360 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:28.422787 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:28.579803 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:28.593603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7f5c3220-c365-451e-8497-50b49eac1918 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.184068 Sep 15 00:47:28.605413 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 254/488] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:28 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:29.220046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:29.220615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:29.226952 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:29.227438 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:29.227901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:29.228597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:29.229052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:29.229504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:29.363034 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:29.371134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:29.372526 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:29.373629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c59d91fe-def1-4822-954b-b6ce1939c7ff tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.158236 Sep 15 00:47:29.374185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 235/489] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:29 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:29.625856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:29.626481 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:29.632811 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:29.633298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:29.633741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:29.634442 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:29.634906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:29.635341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:29.761370 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:29.769661 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-566785b3-4f29-4ac6-83a5-fe376900b90e tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.148133 Sep 15 00:47:29.770224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 255/490] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:29 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:30.398907 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:30.399540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:30.406491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:30.406981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:30.407424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:30.408145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:30.408600 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:30.409022 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:30.539907 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:30.543407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:30.549370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:30.550794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:30.551917 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b3d7bb2f-63cd-4342-aa0e-59a1b97089f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.156932 Sep 15 00:47:30.552465 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 236/491] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:30 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:30.792244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:30.792857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:30.798769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:30.799256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:30.799735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:30.800431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:30.800889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:30.801318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:30.924963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:30.934417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-46a09c57-79ba-4563-864f-3555d62dbc53 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.145868 Sep 15 00:47:30.934923 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 256/492] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:30 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:31.577012 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:31.577658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:31.580152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:31.586991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:31.587508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:31.587948 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:31.588651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:31.589112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:31.589548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:31.716621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:31.724678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:31.726130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:31.727241 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-24671f74-87ee-471e-9ebc-2a9973758027 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.154975 Sep 15 00:47:31.727836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 237/493] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:31 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:31.964178 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:31.964725 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:31.967292 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=90 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:31.972632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:31.973117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:31.973551 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:31.974237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:31.974697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:31.975153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:32.104381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:32.112605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-237b23a0-677e-4afb-95b4-e6073881178d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.152368 Sep 15 00:47:32.113169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 257/494] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:31 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:32.752981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:32.753586 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:32.760199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:32.760681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:32.761112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:32.761798 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:32.762248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:32.762669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:32.897179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:32.905498 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:32.907021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:32.908301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-609a0d0f-2142-4cda-8307-38b68d0f469f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.159533 Sep 15 00:47:32.913217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-a1afc639-4288-495e-b779-84ae9d322fea req-e966242e-7749-4407-b201-feaef01c0e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90bf6477-79b1-4c98-911f-25bda18dbba8", "name": "network-vif-unplugged", "status": "completed", "tag": "71ae9dbc-3746-487e-9b8a-4f6e2e6cb6ad"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:32.914075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 238/495] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:32 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:32.922978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a1afc639-4288-495e-b779-84ae9d322fea req-e966242e-7749-4407-b201-feaef01c0e28 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:32.923459 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a1afc639-4288-495e-b779-84ae9d322fea req-e966242e-7749-4407-b201-feaef01c0e28 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:32.923911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a1afc639-4288-495e-b779-84ae9d322fea req-e966242e-7749-4407-b201-feaef01c0e28 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:32.936126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-a1afc639-4288-495e-b779-84ae9d322fea req-e966242e-7749-4407-b201-feaef01c0e28 service nova] Creating event network-vif-unplugged:71ae9dbc-3746-487e-9b8a-4f6e2e6cb6ad for instance 90bf6477-79b1-4c98-911f-25bda18dbba8 on hv-cinder-85752 Sep 15 00:47:32.941063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-a1afc639-4288-495e-b779-84ae9d322fea req-e966242e-7749-4407-b201-feaef01c0e28 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031455 Sep 15 00:47:32.941639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 258/496] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:47:33.135749 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:33.136299 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:33.143035 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:33.143547 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:33.143990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:33.144692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:33.146731 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:33.147177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:33.296626 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:33.304213 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-59a65633-f031-4bfd-8ae1-a451383e273d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1503 microversion: 2.1 time: 0.172447 Sep 15 00:47:33.304769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 239/497] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:33 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:33.808687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-a6a3c9d2-bf39-4e1c-bb90-fa61c1208772 req-3e4d912d-b0ed-48ed-905d-358a2e396d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90bf6477-79b1-4c98-911f-25bda18dbba8", "name": "network-vif-deleted", "tag": "71ae9dbc-3746-487e-9b8a-4f6e2e6cb6ad"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:33.818117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a6a3c9d2-bf39-4e1c-bb90-fa61c1208772 req-3e4d912d-b0ed-48ed-905d-358a2e396d3a service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:33.818594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a6a3c9d2-bf39-4e1c-bb90-fa61c1208772 req-3e4d912d-b0ed-48ed-905d-358a2e396d3a service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:33.819054 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a6a3c9d2-bf39-4e1c-bb90-fa61c1208772 req-3e4d912d-b0ed-48ed-905d-358a2e396d3a service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:33.829941 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-a6a3c9d2-bf39-4e1c-bb90-fa61c1208772 req-3e4d912d-b0ed-48ed-905d-358a2e396d3a service nova] Creating event network-vif-deleted:71ae9dbc-3746-487e-9b8a-4f6e2e6cb6ad for instance 90bf6477-79b1-4c98-911f-25bda18dbba8 on hv-cinder-85752 Sep 15 00:47:33.834710 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-a6a3c9d2-bf39-4e1c-bb90-fa61c1208772 req-3e4d912d-b0ed-48ed-905d-358a2e396d3a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Sep 15 00:47:33.835277 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 259/498] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:47:33.938203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:33.938758 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:33.945325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:33.945812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:33.946252 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:33.946948 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:33.947408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:33.947868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:34.074824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:34.083433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:34.084901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:34.086001 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-af7fbfcd-66e4-4537-81f4-7cc28a24f5b7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.151730 Sep 15 00:47:34.086557 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 240/499] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:33 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:34.328842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:34.329537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:34.335620 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:34.336101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:34.336535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:34.337216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:34.337668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:34.338091 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:34.402560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:34.410152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-95b8742c-7b9d-472d-9790-0fd57d06f438 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1461 microversion: 2.1 time: 0.086062 Sep 15 00:47:34.410712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 260/500] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:34 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:34.956739 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-74bcbccf-869e-47a6-9352-65a1557dd6b9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'create', calling method: .version_select at 0x7f2f1d0e7550>, body: {"keypair": {"name": "tempest-keypair-947567249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGp/5vkRGuRoBjJ+y4APDWzjE5eDTTXZ7mubaWHO4xRLyynAT5D9JwHb1e03IK/Vjg5wQNJtvmfVYfV+eCikP8Fqi+jnV1wM4qZQ2Itdw0qVgy/U6axMyBneCvVkHWF8w=="}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:34.977183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-74bcbccf-869e-47a6-9352-65a1557dd6b9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Getting quotas for project 7090f91f78534107ba4b5ccd7f80e145. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:47:34.981497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-74bcbccf-869e-47a6-9352-65a1557dd6b9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Getting quotas for user 4e0e6a33679f4cac96704f71dcfa5c01 and project 7090f91f78534107ba4b5ccd7f80e145. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:47:35.018225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-74bcbccf-869e-47a6-9352-65a1557dd6b9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065275 Sep 15 00:47:35.018816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 241/501] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:47:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:47:35.111001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:35.111747 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:35.117638 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:35.118195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:35.118720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:35.120317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:35.120788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:35.121215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:35.271518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:35.281188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:35.284999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:35.286731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ee2dff24-042d-430c-b46c-e17b5f8174f2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1405 microversion: 2.20 time: 0.180117 Sep 15 00:47:35.287819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 261/502] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:35 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:35.434506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:35.435120 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:35.441482 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:35.441980 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:35.442423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:35.443130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:35.443624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:35.444119 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:35.477759 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:35.478239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:35.478670 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:35.479109 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lazy-loading 'fault' on Instance uuid 90bf6477-79b1-4c98-911f-25bda18dbba8 {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:47:35.547507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:35.556559 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1e204859-f32c-4028-a981-ca275d04bc3d tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1303 microversion: 2.1 time: 0.125928 Sep 15 00:47:35.567999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 242/503] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:35 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:36.316289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:36.316904 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:36.322845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.323326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.323810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.324541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.324998 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.325422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.403220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1467200249", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "534fcea4-462b-402d-9da6-e7cef4200229"}], "security_groups": [{"name": "tempest-securitygroup--27771096"}], "key_name": "tempest-keypair-947567249", "user_data": "}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:36.476973 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:36.485177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:36.486660 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:36.487928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a36830f2-5491-4481-ab28-68cba8ef9452 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1598 microversion: 2.20 time: 0.176104 Sep 15 00:47:36.488493 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 262/504] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:47:36 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:47:36.514061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:36.514556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:36.518348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] validate_networks() for [('534fcea4-462b-402d-9da6-e7cef4200229', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:47:36.520568 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.521059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.521670 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.522373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.523017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.523647 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.599298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8de8f817-9abd-40ba-a3d2-6133660f417d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089742 Sep 15 00:47:36.599930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 263/505] 10.222.0.15 () {60 vars in 1316 bytes} [Thu Sep 15 00:47:36 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 00:47:36.604563 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:36.605246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:36.611625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.612125 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.612565 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.613458 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.613925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.614350 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.654371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.654866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.655309 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.655795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lazy-loading 'fault' on Instance uuid 90bf6477-79b1-4c98-911f-25bda18dbba8 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:47:36.739533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f294ab83780460f9679c7655c97a6e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a0252a4fba4f1ebfa9f25a2c6e39a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:36.747219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7ef63fe4-a17e-4ab5-815c-67043736c5b3 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 200 len: 1303 microversion: 2.1 time: 0.146127 Sep 15 00:47:36.748617 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 264/506] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:36 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:36.921841 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:47:36.922288 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:47:36.922902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:47:36.923319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:47:36.923768 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:47:36.937358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.937849 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.938291 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.939031 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:36.939728 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:36.940159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:36.957923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Getting quotas for project 7090f91f78534107ba4b5ccd7f80e145. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:47:36.963605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Getting quotas for user 4e0e6a33679f4cac96704f71dcfa5c01 and project 7090f91f78534107ba4b5ccd7f80e145. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:47:36.975944 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:47:36.978254 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:47:37.034741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-33b2c980-d70a-4066-b382-06d015b807dd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.635969 Sep 15 00:47:37.036049 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 243/507] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:47:36 2022] POST /compute/v2.1/servers => generated 407 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 00:47:37.051359 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1aee1576-2a8b-47fa-a5a8-de9735c44f14 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:37.052735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1aee1576-2a8b-47fa-a5a8-de9735c44f14 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:37.233320 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1aee1576-2a8b-47fa-a5a8-de9735c44f14 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:37.240545 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1aee1576-2a8b-47fa-a5a8-de9735c44f14 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1245 microversion: 2.1 time: 0.197193 Sep 15 00:47:37.241117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 265/508] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:37 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1245 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:37.771669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:37.772437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] [instance: 90bf6477-79b1-4c98-911f-25bda18dbba8] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:37.779775 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:37.780270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:37.780802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:37.781400 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:37.782023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:37.782658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:37.798929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] HTTP exception thrown: Instance 90bf6477-79b1-4c98-911f-25bda18dbba8 could not be found. Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Request method failure captured: Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 HTTP/1.1 Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInWaImG-zJilY8tNrciK6ArsgbpQa1zf5W6Wj8B_v7wTmChm31B3jL2bNKjw07jGgpX6watuYTo2jgsXWRAwXx_oMCeHszmoD1wx_i1I4diBf4w_wbg9EZsiKLhD2-7ZN2G65bYPndm-UC7JRR8xAcS7EifdwrTZDeX04E7mE4JS5bI Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 06a0252a4fba4f1ebfa9f25a2c6e39a4 Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesActionsTest-1389062041 Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:47:37.800653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/06a0252a4fba4f1ebfa9f25a2c6e39a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_06a0252a4fba4f1ebfa9f25a2c6e39a4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/06a0252a4fba4f1ebfa9f25a2c6e39a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/06a0252a4fba4f1ebfa9f25a2c6e39a4"}]}] Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesActionsTest-1389062041 Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 06a0252a4fba4f1ebfa9f25a2c6e39a4 Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesActionsTest-1389062041 Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesActionsTest-1389062041-project Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 5f294ab83780460f9679c7655c97a6e4 Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesActionsTest-1389062041-project Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 90bf6477-79b1-4c98-911f-25bda18dbba8 could not be found. Sep 15 00:47:37.802171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '90bf6477-79b1-4c98-911f-25bda18dbba8'} Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90bf6477-79b1-4c98-911f-25bda18dbba8 could not be found. Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:47:37.803019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90bf6477-79b1-4c98-911f-25bda18dbba8 could not be found. Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90bf6477-79b1-4c98-911f-25bda18dbba8 could not be found. Sep 15 00:47:37.804442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:47:37.805553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] Returning 404 to user: Instance 90bf6477-79b1-4c98-911f-25bda18dbba8 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:47:37.805553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-cae2a2ff-a4d1-4c6c-ab06-0a8ade0b2610 tempest-VolumesActionsTest-1389062041 tempest-VolumesActionsTest-1389062041-project] 10.222.0.15 "GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8" status: 404 len: 111 microversion: 2.1 time: 0.035880 Sep 15 00:47:37.806622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 244/509] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:37 2022] GET /compute/v2.1/servers/90bf6477-79b1-4c98-911f-25bda18dbba8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:38.259963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-c8a842fd-f8d8-4398-8101-c42af6efb0be req-1034b773-3a1e-4884-8dd3-e2abcd8c6dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "469fcc1e-0231-4642-b72f-c2bf7fd7eb07", "tag": "86077b58-abc6-43a7-9b01-51a893794c4e"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:38.266838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:38.267462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:38.276646 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c8a842fd-f8d8-4398-8101-c42af6efb0be req-1034b773-3a1e-4884-8dd3-e2abcd8c6dc8 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:38.276895 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:38.277319 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c8a842fd-f8d8-4398-8101-c42af6efb0be req-1034b773-3a1e-4884-8dd3-e2abcd8c6dc8 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:38.277423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:38.277781 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c8a842fd-f8d8-4398-8101-c42af6efb0be req-1034b773-3a1e-4884-8dd3-e2abcd8c6dc8 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:38.277902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:38.278538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:38.279546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:38.280008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:38.289022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-c8a842fd-f8d8-4398-8101-c42af6efb0be req-1034b773-3a1e-4884-8dd3-e2abcd8c6dc8 service nova] Creating event network-changed:86077b58-abc6-43a7-9b01-51a893794c4e for instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 on hv-cinder-85752 Sep 15 00:47:38.294927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-c8a842fd-f8d8-4398-8101-c42af6efb0be req-1034b773-3a1e-4884-8dd3-e2abcd8c6dc8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038871 Sep 15 00:47:38.296331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 266/510] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:47:38.381358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:38.391180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-92109714-918e-4829-b63f-2bd633937196 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1297 microversion: 2.1 time: 0.128561 Sep 15 00:47:38.400266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 245/511] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:38 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1297 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:39.415017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:39.415821 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:39.422871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:39.423457 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:39.423996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:39.424806 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:39.425334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:39.425832 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:39.489034 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:39.496914 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-28b361e6-eb1c-465e-a0de-55909b64badc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1303 microversion: 2.1 time: 0.086444 Sep 15 00:47:39.497630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 267/512] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:39 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:39.655700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7365835b-b1c7-4365-8443-58c7976fb687", "device": "/dev/sdb"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:39.659402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:39.666395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:39.667218 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:39.667709 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:39.668418 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:39.668874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:39.675432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:40.520017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:40.520630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:40.526717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:40.527207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:40.527685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:40.528394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:40.528849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:40.529393 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:40.533584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:40.657094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:40.664697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e79822f1-47c2-4d1a-939e-fc6c8eb9a4b5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.148545 Sep 15 00:47:40.665254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 268/513] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:40 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:41.687520 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:41.688134 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:41.694012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:41.694493 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:41.694926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:41.695648 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:41.696133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:41.696555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:41.821489 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:41.829707 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0e5a6d36-8ce7-4814-ba7e-53132d8257bd tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.146566 Sep 15 00:47:41.830267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 269/514] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:41 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:42.851421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:42.852057 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:42.858169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:42.858656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:42.859087 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:42.859801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:42.860258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:42.860685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:43.162852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:43.171513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c980f777-491f-4f2b-acd6-012a2592de89 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.323787 Sep 15 00:47:43.172386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 270/515] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:42 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:47:43.613369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-56f6b4e0-c5f6-458b-a001-6e9c5cdfd5cd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "POST /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.961920 Sep 15 00:47:43.615868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 246/516] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:47:39 2022] POST /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05/os-volume_attachments => generated 194 bytes in 3966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:47:44.193205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-513e1f58-540f-41c6-80f7-2cedad00e0da req-eaf1f141-1036-4f52-b7e8-b5bdb7bde746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583bc208-8f85-4abe-be0f-096127a8a5fb", "tag": "d0e29cfb-c141-4cd4-ab78-e1b32fb810ef"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:44.194816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:44.195660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:44.203349 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:44.203548 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-513e1f58-540f-41c6-80f7-2cedad00e0da req-eaf1f141-1036-4f52-b7e8-b5bdb7bde746 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:44.204045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:44.204214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-513e1f58-540f-41c6-80f7-2cedad00e0da req-eaf1f141-1036-4f52-b7e8-b5bdb7bde746 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:44.204576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:44.204725 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-513e1f58-540f-41c6-80f7-2cedad00e0da req-eaf1f141-1036-4f52-b7e8-b5bdb7bde746 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:44.205292 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:44.205754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:44.206192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:44.227985 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-513e1f58-540f-41c6-80f7-2cedad00e0da req-eaf1f141-1036-4f52-b7e8-b5bdb7bde746 service nova] Creating event network-changed:d0e29cfb-c141-4cd4-ab78-e1b32fb810ef for instance 583bc208-8f85-4abe-be0f-096127a8a5fb on hv-cinder-85752 Sep 15 00:47:44.240385 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-513e1f58-540f-41c6-80f7-2cedad00e0da req-eaf1f141-1036-4f52-b7e8-b5bdb7bde746 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050448 Sep 15 00:47:44.240979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 271/517] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:47:44.346615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:44.354390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d6aef9d6-7fce-4e0e-8fbf-b86530975900 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.163949 Sep 15 00:47:44.354885 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 247/518] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:44 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:45.377557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:45.378260 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:45.384765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:45.385253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:45.385691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:45.386415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:45.386874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:45.387323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:45.521789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:45.530215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-38512e28-154b-4e4d-86f4-6874c41ec1a4 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.157060 Sep 15 00:47:45.530720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 272/519] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:45 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:46.552963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:46.553574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:46.560619 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:46.561100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:46.561535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:46.562216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:46.562666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:46.563086 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:46.691931 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:46.699437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-132f7574-cff9-4a52-821e-d246369bce47 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.150359 Sep 15 00:47:46.700010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 248/520] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:46 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:47.722332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:47.723001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:47.725076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:47.731767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:47.732266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:47.732708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:47.733421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:47.733885 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:47.734328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:47.861240 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:47.869458 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ca5256b9-738c-4106-9158-7a78c3f63bd6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.151195 Sep 15 00:47:47.870027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 273/521] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:47 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:48.893792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:48.894466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:48.896502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:48.897164 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=10 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:48.904369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:48.904863 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:48.905298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:48.906003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:48.906462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:48.906886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:49.043682 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:49.051535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-773c3e60-fbe4-43ce-bf88-0c5a8865446c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.161598 Sep 15 00:47:49.052325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 249/522] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:48 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:50.074045 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:50.074695 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:50.080686 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:50.081184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:50.081621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:50.082321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:50.082779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:50.083207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:50.212113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:50.220383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-662d33eb-63c2-4c5d-99b1-12bfb7a5581a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.150120 Sep 15 00:47:50.220792 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 274/523] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:50 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:51.243073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:51.243898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:51.251002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:51.251503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:51.251962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:51.252660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:51.253121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:51.253551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:51.429080 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:51.436717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4bbaa698-aeac-4103-9e63-1ff563e67500 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.198513 Sep 15 00:47:51.437271 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 250/524] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:51 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:52.458252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:52.458859 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:52.464691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:52.465179 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:52.466232 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:52.466986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:52.467447 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:52.467899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:52.673535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:52.692270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eb21037e-247e-4ed5-94df-9aed186735f9 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.237384 Sep 15 00:47:52.697535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 275/525] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:52 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:53.717361 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:53.718011 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:53.725058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:53.725618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:53.726060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:53.726767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:53.727222 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:53.727683 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:53.887666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:53.895472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7b95b075-f057-4da7-8d42-811112729ac6 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.182028 Sep 15 00:47:53.912516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 251/526] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:53 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:54.919225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:54.920577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:54.932025 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:54.933417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:54.934143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:54.935753 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:54.937244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:54.938109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:55.148252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:55.158609 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b138e1a1-d825-4579-8047-49a57617c39a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.244105 Sep 15 00:47:55.159719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 276/527] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:54 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:56.182274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:56.182905 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:56.194557 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:56.195057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:56.195522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:56.207311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:56.207826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:56.208268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:56.514011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-38e91e6e-6af0-418a-ace5-ada73b17e97e req-da3251e9-a293-4cf7-8040-44318db8d720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583bc208-8f85-4abe-be0f-096127a8a5fb", "name": "network-vif-plugged", "status": "completed", "tag": "d0e29cfb-c141-4cd4-ab78-e1b32fb810ef"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:47:56.532732 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-38e91e6e-6af0-418a-ace5-ada73b17e97e req-da3251e9-a293-4cf7-8040-44318db8d720 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:56.533252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-38e91e6e-6af0-418a-ace5-ada73b17e97e req-da3251e9-a293-4cf7-8040-44318db8d720 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:56.533828 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-38e91e6e-6af0-418a-ace5-ada73b17e97e req-da3251e9-a293-4cf7-8040-44318db8d720 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:56.563918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-38e91e6e-6af0-418a-ace5-ada73b17e97e req-da3251e9-a293-4cf7-8040-44318db8d720 service nova] Creating event network-vif-plugged:d0e29cfb-c141-4cd4-ab78-e1b32fb810ef for instance 583bc208-8f85-4abe-be0f-096127a8a5fb on hv-cinder-85752 Sep 15 00:47:56.578517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-38e91e6e-6af0-418a-ace5-ada73b17e97e req-da3251e9-a293-4cf7-8040-44318db8d720 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065870 Sep 15 00:47:56.581270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 277/528] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:47:56.643035 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:56.676879 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-76f146c6-895c-477a-b323-d07e3dff2478 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.498888 Sep 15 00:47:56.677689 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 252/529] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:56 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:57.700617 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:57.701883 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:57.716177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:57.717082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:57.717730 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:57.719856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:57.720757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:57.722157 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:57.904370 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:57.912609 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-54ae6349-b730-434b-9d05-ddc516fbe8b0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.216901 Sep 15 00:47:57.913972 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 278/530] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:57 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:47:58.939947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:47:58.941730 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:47:58.949437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:58.950293 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:58.950809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:58.951667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:47:58.952220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:47:58.953477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:47:59.198145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:47:59.210490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5e538d29-885a-41e3-a0b1-e488975cc379 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1369 microversion: 2.1 time: 0.274848 Sep 15 00:47:59.211957 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 253/531] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:47:58 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:48:00.236315 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:00.237708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:00.244996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:00.245490 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:00.245932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:00.247511 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:00.247984 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:00.248415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:00.452105 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:48:00.470909 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a0072aa8-376a-4ec6-8ffc-d58c3f86ba12 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1562 microversion: 2.1 time: 0.239453 Sep 15 00:48:00.483138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 279/532] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:00 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1562 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:48:00.517596 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:00.518902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:00.527402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:00.528693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:00.529315 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:00.530180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:00.530798 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:00.531953 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:00.540256 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:00.656630 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-324075c3-c79c-4819-a87e-5e7238baa280 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159391 Sep 15 00:48:00.658399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 254/533] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 00:48:00 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:48:02.740214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-44aa77a4-6959-4642-8a68-eab1a123b92f req-6a689566-4ae7-457a-8c92-30c5fe012b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583bc208-8f85-4abe-be0f-096127a8a5fb", "tag": "d0e29cfb-c141-4cd4-ab78-e1b32fb810ef"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:48:02.759341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=50 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:02.770255 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-44aa77a4-6959-4642-8a68-eab1a123b92f req-6a689566-4ae7-457a-8c92-30c5fe012b3e service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:02.774101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-44aa77a4-6959-4642-8a68-eab1a123b92f req-6a689566-4ae7-457a-8c92-30c5fe012b3e service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:02.775238 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-44aa77a4-6959-4642-8a68-eab1a123b92f req-6a689566-4ae7-457a-8c92-30c5fe012b3e service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:02.813556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-44aa77a4-6959-4642-8a68-eab1a123b92f req-6a689566-4ae7-457a-8c92-30c5fe012b3e service nova] Creating event network-changed:d0e29cfb-c141-4cd4-ab78-e1b32fb810ef for instance 583bc208-8f85-4abe-be0f-096127a8a5fb on hv-cinder-85752 Sep 15 00:48:02.826414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-44aa77a4-6959-4642-8a68-eab1a123b92f req-6a689566-4ae7-457a-8c92-30c5fe012b3e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090319 Sep 15 00:48:02.839621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 280/534] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:48:08.634657 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-08e8821b-5ed9-486c-98ab-a6c10142a573 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Action: 'create', calling method: .version_select at 0x7f2f1d1c4e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-545593477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnwSoLZIG9ni/lfyNaOf4bDnPmopIF5Pr0l4/E2XJKKGWX8Yfv3YTmy5+P6fxy/+5E2l84FzjW0a2b9GkKIHjPpKQb3Inot/Ko167aIwTQyOsXjchO9jznbMsWSh5L10g=="}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:48:08.653145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:08.670996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-08e8821b-5ed9-486c-98ab-a6c10142a573 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Getting quotas for project 743501da05424df197d7af03d32eabb3. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:48:08.678548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-08e8821b-5ed9-486c-98ab-a6c10142a573 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Getting quotas for user 65f9c7fc74c448829608dab23d7023ce and project 743501da05424df197d7af03d32eabb3. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:48:08.712580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-08e8821b-5ed9-486c-98ab-a6c10142a573 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.380808 Sep 15 00:48:08.722111 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 255/535] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:48:08 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:48:33.505563 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 00:48:33.506294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Thu Sep 15 00:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05/os-volume_attachments/7365835b-b1c7-4365-8443-58c7976fb687 (ip 10.222.0.15) !!! Sep 15 00:48:33.507056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=64 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:33.507872 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:33.512585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:33.513152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:33.521280 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:33.521765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:33.522200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:33.522893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:33.523345 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:33.523796 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:33.652058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lazy-loading 'services' on Instance uuid 200f747f-85db-4561-aaaa-65b90c5c9f05 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:48:33.773061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c68bcf18-d06c-4d33-9d39-6b2149d3646f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "DELETE /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05/os-volume_attachments/7365835b-b1c7-4365-8443-58c7976fb687" status: 202 len: 0 microversion: 2.1 time: 0.268926 Sep 15 00:48:33.773704 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 281/536] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:48:33 2022] DELETE /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05/os-volume_attachments/7365835b-b1c7-4365-8443-58c7976fb687 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:48:35.954012 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:35.954621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:35.956723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:35.957398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=4 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:35.958673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:35.967860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:35.968370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:35.968809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:35.969519 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:35.969974 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:35.970401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:35.994829 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:48:36.075065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-cfc3dc14-d585-446b-b419-b073b60417b4 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "DELETE /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 204 len: 0 microversion: 2.1 time: 0.123885 Sep 15 00:48:36.075662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 256/537] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:48:35 2022] DELETE /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:48:36.084322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:36.085071 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:36.091413 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:36.091933 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:36.092368 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:36.093061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:36.093515 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:36.093940 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:36.230393 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:48:36.238439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-06b191d1-4ab0-4759-b7b6-7321f58ef18e tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1515 microversion: 2.1 time: 0.158291 Sep 15 00:48:36.239046 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 282/538] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:36 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:48:37.263988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:37.264692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:37.271035 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:37.271548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:37.271989 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:37.272823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:37.273277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:37.273699 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:37.405098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:48:37.412691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7a41745b-2cc2-40a2-b948-ef01f5d3011b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1515 microversion: 2.1 time: 0.153624 Sep 15 00:48:37.413368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 257/539] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:37 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:48:38.436302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:38.436916 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:38.442851 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:38.443340 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:38.443813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:38.444515 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:38.444974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:38.445405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:38.579879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:48:38.587562 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2d1f0efd-56f8-43c3-9f10-337224b41a26 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1515 microversion: 2.1 time: 0.155685 Sep 15 00:48:38.588140 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 283/540] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:38 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:48:39.567671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-32450edf-e1cd-4411-ac1e-f17d24754c07 req-0a6f1384-50ec-41a0-9eb5-97701dbd8a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200f747f-85db-4561-aaaa-65b90c5c9f05", "name": "network-vif-deleted", "tag": "8ad59f1e-2fde-43f8-a49d-a9e0b059c929"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:48:39.578253 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-32450edf-e1cd-4411-ac1e-f17d24754c07 req-0a6f1384-50ec-41a0-9eb5-97701dbd8a5f service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:39.578736 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-32450edf-e1cd-4411-ac1e-f17d24754c07 req-0a6f1384-50ec-41a0-9eb5-97701dbd8a5f service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:39.579230 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-32450edf-e1cd-4411-ac1e-f17d24754c07 req-0a6f1384-50ec-41a0-9eb5-97701dbd8a5f service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:39.591113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-32450edf-e1cd-4411-ac1e-f17d24754c07 req-0a6f1384-50ec-41a0-9eb5-97701dbd8a5f service nova] Creating event network-vif-deleted:8ad59f1e-2fde-43f8-a49d-a9e0b059c929 for instance 200f747f-85db-4561-aaaa-65b90c5c9f05 on hv-cinder-85752 Sep 15 00:48:39.596113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-32450edf-e1cd-4411-ac1e-f17d24754c07 req-0a6f1384-50ec-41a0-9eb5-97701dbd8a5f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032091 Sep 15 00:48:39.596704 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 258/541] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:48:39.610073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:39.610692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:39.616751 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:39.617249 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:39.617691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:39.618407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:39.618868 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:39.619534 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:39.699770 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:48:39.707866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dbab3ddd-b188-4275-82fe-e8b3885e1bd2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 200 len: 1304 microversion: 2.1 time: 0.101560 Sep 15 00:48:39.708429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 284/542] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:39 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:48:40.737440 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:40.739864 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: 200f747f-85db-4561-aaaa-65b90c5c9f05] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:40.751912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:40.752911 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:40.753747 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:40.754903 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:40.755549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:40.756240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:40.772808 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] HTTP exception thrown: Instance 200f747f-85db-4561-aaaa-65b90c5c9f05 could not be found. Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Request method failure captured: Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 HTTP/1.1 Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInXrjxUhnzWsqXPquUW0aqWuOJ4guwldoCg4WA8ppXAFBspZEiv0y10rUxp7q2jfcD-WJobxzJ9nmXdAGPH46InGvWSgvuUNo3N8GdjAqZKDCbVwv0UW95S0nbugA6df_bDdKkX_6xRLaORfDbo_GUzaBWfnYSnjI_Pjmc_JvVA-9oE Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 39a872cd1b1e451ba5786fe246950f73 Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1280686874 Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:48:40.774424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a872cd1b1e451ba5786fe246950f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_39a872cd1b1e451ba5786fe246950f73", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a872cd1b1e451ba5786fe246950f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/39a872cd1b1e451ba5786fe246950f73"}]}] Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesSnapshotTestJSON-1280686874 Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 39a872cd1b1e451ba5786fe246950f73 Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1280686874 Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesSnapshotTestJSON-1280686874-project Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: b8e4bda3331540d1a0b869270db9c25d Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesSnapshotTestJSON-1280686874-project Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 200f747f-85db-4561-aaaa-65b90c5c9f05 could not be found. Sep 15 00:48:40.776248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '200f747f-85db-4561-aaaa-65b90c5c9f05'} Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200f747f-85db-4561-aaaa-65b90c5c9f05 could not be found. Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:48:40.777824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200f747f-85db-4561-aaaa-65b90c5c9f05 could not be found. Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200f747f-85db-4561-aaaa-65b90c5c9f05 could not be found. Sep 15 00:48:40.779268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:48:40.781882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Returning 404 to user: Instance 200f747f-85db-4561-aaaa-65b90c5c9f05 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:48:40.781882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a9fff975-6b19-4b1a-8f81-1c71e233ca50 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05" status: 404 len: 111 microversion: 2.1 time: 0.047454 Sep 15 00:48:40.781882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 259/543] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:40 2022] GET /compute/v2.1/servers/200f747f-85db-4561-aaaa-65b90c5c9f05 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:48:47.995115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:47.995638 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:48.001822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:48.002312 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:48.002743 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:48.003732 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:48.004196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:48.004629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:48.029120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-77c17cd1-8da0-416b-87e3-27dcd0c7f05d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/ips" status: 200 len: 144 microversion: 2.1 time: 0.037753 Sep 15 00:48:48.029693 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 285/544] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:48:47 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:48:51.062024 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "422f3712-297e-4ed5-845b-5d9ca1e16d99"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:48:51.064681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:51.067408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:51.068072 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:51.075039 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:51.075704 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:51.076141 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:51.076828 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:51.077295 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:51.077718 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:51.371204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0ccd94b9-838f-4e01-9254-e6699b550907 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312524 Sep 15 00:48:51.377073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 260/545] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:48:51 2022] POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:48:56.930134 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1893051933", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "networks": [{"uuid": "a0341a54-b663-41cb-8fe1-4ffc2a77107e"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:48:56.985737 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] validate_networks() for [('a0341a54-b663-41cb-8fe1-4ffc2a77107e', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:48:57.325946 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:48:57.326373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:48:57.326846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:48:57.327256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:48:57.327706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:48:57.336629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:57.337117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:57.337554 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:57.338850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:57.339314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:57.339763 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:57.356538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Getting quotas for project 39a872cd1b1e451ba5786fe246950f73. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:48:57.360386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Getting quotas for user b8e4bda3331540d1a0b869270db9c25d and project 39a872cd1b1e451ba5786fe246950f73. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:48:57.371096 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:48:57.373416 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:48:57.421094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7d6842b0-0517-4aa7-9da4-4dd21e78b3ed tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494805 Sep 15 00:48:57.421745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 286/546] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:48:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 00:48:57.433128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b2c51a4f-b8c4-4bda-8ab0-c9ae7d573962 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:57.433831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b2c51a4f-b8c4-4bda-8ab0-c9ae7d573962 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:57.489535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b2c51a4f-b8c4-4bda-8ab0-c9ae7d573962 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:48:57.496408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b2c51a4f-b8c4-4bda-8ab0-c9ae7d573962 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1219 microversion: 2.1 time: 0.067462 Sep 15 00:48:57.496976 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 261/547] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:57 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:48:58.519926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:58.520575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:58.528795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:58.529380 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:58.529903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:58.530740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:58.531269 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:58.531729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:58.592720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:48:58.600318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-825a3e72-1d99-4a26-8dd5-4ba30e9c7cbd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1271 microversion: 2.1 time: 0.084660 Sep 15 00:48:58.600889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 287/548] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:58 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:48:59.624633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:48:59.625149 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:48:59.632494 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:59.632986 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:59.633423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:59.634123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:48:59.634577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:48:59.635003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:48:59.767894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:48:59.775779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7b297c78-e84e-4fb9-9efc-81c8c1b527bb tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.155085 Sep 15 00:48:59.776673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 262/549] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:48:59 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:00.134916 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-54260de7-320f-4430-8f13-f8624387ac6e req-3d2aee6f-17c4-403a-8e5b-8855a96d043e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f997b231-b0b5-469a-813f-00fda0f634a1", "tag": "644d212f-2458-4aeb-a5e5-94bbe347339c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:00.146577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-54260de7-320f-4430-8f13-f8624387ac6e req-3d2aee6f-17c4-403a-8e5b-8855a96d043e service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:00.147065 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-54260de7-320f-4430-8f13-f8624387ac6e req-3d2aee6f-17c4-403a-8e5b-8855a96d043e service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:00.147515 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-54260de7-320f-4430-8f13-f8624387ac6e req-3d2aee6f-17c4-403a-8e5b-8855a96d043e service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:00.162849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-54260de7-320f-4430-8f13-f8624387ac6e req-3d2aee6f-17c4-403a-8e5b-8855a96d043e service nova] Creating event network-changed:644d212f-2458-4aeb-a5e5-94bbe347339c for instance f997b231-b0b5-469a-813f-00fda0f634a1 on hv-cinder-85752 Sep 15 00:49:00.164284 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-54260de7-320f-4430-8f13-f8624387ac6e req-3d2aee6f-17c4-403a-8e5b-8855a96d043e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033017 Sep 15 00:49:00.164892 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 288/550] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:49:00.800334 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:00.801125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:00.808051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:00.808530 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:00.809065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:00.809877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:00.810447 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:00.810884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:00.951350 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:00.960681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-59f04758-2b9c-4164-bfbc-ce1118373ac9 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.164196 Sep 15 00:49:00.961595 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 263/551] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:00 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:01.986521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:01.987238 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:01.993641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:01.995055 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:01.995684 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:01.996560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:01.997020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:01.997453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:02.196652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:02.204616 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e7b424bd-a76a-45e1-9e56-198b81a5f098 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.223211 Sep 15 00:49:02.205196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 289/552] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:01 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:03.228056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:03.228708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:03.235137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:03.235745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:03.236231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:03.236940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:03.237390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:03.237811 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:03.461394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:03.470652 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a9af4dfd-5131-462a-9acb-f13e2cbf4ba1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.246553 Sep 15 00:49:03.471316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 264/553] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:03 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:04.494766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:04.495403 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:04.500143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:04.506203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:04.506847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:04.507789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:04.508503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:04.521165 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:04.522075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:04.549033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:04.710546 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:04.719047 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c50e834f-67eb-4f0f-b7ef-074e15e924a2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.229171 Sep 15 00:49:04.719753 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 290/554] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:04 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:05.742024 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:05.742634 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:05.756472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:05.757216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:05.758032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:05.758939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:05.764187 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:05.764574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:05.985140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:05.999124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fbc7e0de-ab6f-4b74-a806-3314cfb9d4a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.260662 Sep 15 00:49:06.000927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 265/555] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:05 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:07.022153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:07.022762 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:07.029739 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:07.030448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:07.031041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:07.031969 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:07.032581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:07.033163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:07.170835 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:07.178703 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c21c94e7-89e8-4990-9cdf-7443b89841bd tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.160048 Sep 15 00:49:07.179720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 291/556] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:07 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:08.202207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:08.203512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:08.209603 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:08.211845 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:08.212764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:08.213589 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:08.214554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:08.215244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:08.216147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:08.494853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:08.506492 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9f5ccd03-9ddc-4f31-925c-770131752702 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.307769 Sep 15 00:49:08.507501 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 266/557] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:08 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:08.586688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f574ce6a-7d1e-424d-8032-f90a1939fc2a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:08.593918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:08.595316 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:08.598035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f574ce6a-7d1e-424d-8032-f90a1939fc2a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:08.598844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f574ce6a-7d1e-424d-8032-f90a1939fc2a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:08.600535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f574ce6a-7d1e-424d-8032-f90a1939fc2a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:08.679711 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f574ce6a-7d1e-424d-8032-f90a1939fc2a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Going to try to stop instance {{(pid=127199) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 00:49:08.747759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f574ce6a-7d1e-424d-8032-f90a1939fc2a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/action" status: 202 len: 0 microversion: 2.1 time: 0.164644 Sep 15 00:49:08.750337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 292/558] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:49:08 2022] POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 00:49:08.758756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:08.759372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:08.769360 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:08.770816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:08.771821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:08.776059 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:08.776962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:08.777674 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:08.778771 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-94abff21-577d-411c-b2b2-9397c8f2941d req-a6cb7089-d342-4cc3-8c9d-005cc9056ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f997b231-b0b5-469a-813f-00fda0f634a1", "name": "network-vif-plugged", "status": "completed", "tag": "644d212f-2458-4aeb-a5e5-94bbe347339c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:08.800230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-94abff21-577d-411c-b2b2-9397c8f2941d req-a6cb7089-d342-4cc3-8c9d-005cc9056ace service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:08.800719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-94abff21-577d-411c-b2b2-9397c8f2941d req-a6cb7089-d342-4cc3-8c9d-005cc9056ace service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:08.801160 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-94abff21-577d-411c-b2b2-9397c8f2941d req-a6cb7089-d342-4cc3-8c9d-005cc9056ace service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:08.828448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-94abff21-577d-411c-b2b2-9397c8f2941d req-a6cb7089-d342-4cc3-8c9d-005cc9056ace service nova] Creating event network-vif-plugged:644d212f-2458-4aeb-a5e5-94bbe347339c for instance f997b231-b0b5-469a-813f-00fda0f634a1 on hv-cinder-85752 Sep 15 00:49:08.836075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-94abff21-577d-411c-b2b2-9397c8f2941d req-a6cb7089-d342-4cc3-8c9d-005cc9056ace service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062766 Sep 15 00:49:08.837058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 293/559] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:49:09.014938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1200594723", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-545593477", "security_groups": [{"name": "tempest-secgroup-smoke-1706413837"}], "networks": [{"uuid": "4290f87e-df9b-42ba-bf4c-3cb460fcfafb"}], "block_device_mapping_v2": [{"uuid": "4615222f-134a-4fae-bd6b-be080d985181", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:09.038437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:09.048811 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-17122533-0420-452d-b0f7-1a5fdb827eb3 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.293858 Sep 15 00:49:09.050793 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 267/560] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:08 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:09.305678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] validate_networks() for [('4290f87e-df9b-42ba-bf4c-3cb460fcfafb', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:49:09.534070 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:09.535314 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:09.544038 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:09.544523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:09.544960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:09.545660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:09.546291 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:09.546798 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:09.726996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:09.735658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1b53d114-a55a-48b5-ab42-e5b3ca4c2cc8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.207042 Sep 15 00:49:09.736501 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 268/561] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:09 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:10.062420 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:49:10.064560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:49:10.065405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:49:10.066035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:49:10.066762 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:49:10.074235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:10.075083 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:10.081559 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:10.086133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:10.086979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:10.088331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:10.089300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:10.089536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:10.089765 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:10.090436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:10.090549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:10.090954 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:10.091396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:10.091667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:10.115095 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Getting quotas for project 743501da05424df197d7af03d32eabb3. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:49:10.127064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Getting quotas for user 65f9c7fc74c448829608dab23d7023ce and project 743501da05424df197d7af03d32eabb3. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:49:10.257316 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:49:10.261149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4615222f-134a-4fae-bd6b-be080d985181',volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:49:10.330559 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:10.341789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3eb2ecf9-d38d-4d86-8cdc-5e6149fd232c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.271864 Sep 15 00:49:10.342363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 269/562] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:10 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:10.460379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dab74b38-bb9e-415d-8f05-d8b4908c061f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.449825 Sep 15 00:49:10.462733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 294/563] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:49:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:49:10.473854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d37f98fa-998f-41ff-a328-76e0c9c2ea81 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:10.474653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d37f98fa-998f-41ff-a328-76e0c9c2ea81 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:10.570171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d37f98fa-998f-41ff-a328-76e0c9c2ea81 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:10.578168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d37f98fa-998f-41ff-a328-76e0c9c2ea81 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1088 microversion: 2.1 time: 0.108293 Sep 15 00:49:10.582399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 270/564] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:10 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1088 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:10.766500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:10.768365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:10.775732 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:10.776438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:10.776957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:10.777785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:10.786492 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:10.787057 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:10.991982 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:11.002531 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ec9ed4b6-bafa-4e4d-9f63-a6167dc4d82c tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.247194 Sep 15 00:49:11.005321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 295/565] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:10 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:11.365314 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:11.366035 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:11.379978 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:11.384042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:11.387166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:11.388065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:11.388892 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:11.389567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:11.605800 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:11.607033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:11.613979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:11.614477 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:11.614915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:11.615675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:11.616129 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:11.616553 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:11.720710 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:11.735510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-03a1531b-d8f2-4ed9-9780-ec44aa88f10c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1130 microversion: 2.1 time: 0.133687 Sep 15 00:49:11.748682 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 296/566] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:11 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1130 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:49:12.034402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:12.035330 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:12.044466 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:12.045221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:12.046769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:12.048703 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:12.049376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:12.049977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:12.089475 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:12.102458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8e60227c-4426-4bb3-a211-b53ee1e686e9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.739345 Sep 15 00:49:12.105686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 271/567] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:11 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:12.232977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:12.242805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ca9298cb-512a-40a2-8097-8304052b96d8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1319 microversion: 2.1 time: 0.215840 Sep 15 00:49:12.243920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 297/568] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:12 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:12.762196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:12.762819 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:12.777804 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:12.779199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:12.781353 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:12.782267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:12.783401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:12.784043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:12.871368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:12.881567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e866f98d-43da-4eb6-8560-42e7523047ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1186 microversion: 2.1 time: 0.123524 Sep 15 00:49:12.882069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 272/569] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:12 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1186 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:13.126932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:13.129620 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:13.139133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:13.139667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:13.140366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:13.141935 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:13.142805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:13.143440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:13.268956 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:13.270858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:13.280387 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:13.281578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:13.282215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:13.283551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:13.285731 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:13.286374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:13.385819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:13.395076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-57ef198d-e56f-46b7-9ce5-d60dfd8308e8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.272745 Sep 15 00:49:13.400639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 298/570] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:13 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:13.507242 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:13.517789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9cf608f5-668f-41d4-a15f-5b28520fff69 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1508 microversion: 2.1 time: 0.254745 Sep 15 00:49:13.528533 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 273/571] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:13 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:49:13.541624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "209e6b11-2700-4721-ba94-87692a8a9a5e", "device": "/dev/sdb"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:13.545197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:13.551814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:13.552652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:13.553302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:13.554219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:13.554889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:13.555524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:13.905523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:13.906209 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:13.944715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:13.945446 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:13.946055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:13.947005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:13.947465 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:13.948005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:14.085079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1e8d9cc0-bccc-428d-a508-248f767a296b tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "POST /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547698 Sep 15 00:49:14.086012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 299/572] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:49:13 2022] POST /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:49:14.132519 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:14.157395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-cd206f99-7e97-4646-bec4-b75268a6d544 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1204 microversion: 2.1 time: 0.255304 Sep 15 00:49:14.164489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 274/573] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:13 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1204 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:14.441147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:14.441778 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:14.448422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-12fd7889-245a-4e36-853e-d57f223becae tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Action: 'create', calling method: .version_select at 0x7f2f1d0b45e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-309604362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdEEopEz9IZOSb98eGKA5g2XWe2PDty0tGzqpwc6fAIa4tZoe11Kloty8UaAei67wThNWqD/8CfRym+mccvMtbFdFZlS6rNU0cn6uPEnv/h15Bh+nxQJwTGlPFlywMWTg=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:14.448996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:14.449881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:14.450554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:14.451501 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:14.452250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:14.452873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:14.472628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-12fd7889-245a-4e36-853e-d57f223becae tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Getting quotas for project 53d8d76185c44a159439c0f7a0e88b31. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:49:14.477323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-12fd7889-245a-4e36-853e-d57f223becae tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Getting quotas for user d308262224af475091e6aa494ea839b1 and project 53d8d76185c44a159439c0f7a0e88b31. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:49:14.522505 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-12fd7889-245a-4e36-853e-d57f223becae tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.352075 Sep 15 00:49:14.530468 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 300/574] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:49:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:49:14.739996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:14.755984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f41c17c0-e5ed-412e-8f52-3920c1afba39 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.319826 Sep 15 00:49:14.767717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 275/575] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:14 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:15.192847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:15.193936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:15.203523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:15.204240 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:15.205014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:15.206102 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:15.206755 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:15.207348 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:15.447359 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:15.460760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-50b898b0-52d1-4aca-93af-05d8e0e74bf6 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.273949 Sep 15 00:49:15.461564 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 301/576] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:15 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:15.564660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-76127290-c0cd-479a-b3d4-9d2e86d552b7 req-969b3013-a55e-4e36-a878-5498aae89e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58c94a4-c708-4b2f-b8b1-fa336f60aa4b", "tag": "f8e5a3ed-229c-4186-8197-286fa9b6a050"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:15.593640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-76127290-c0cd-479a-b3d4-9d2e86d552b7 req-969b3013-a55e-4e36-a878-5498aae89e94 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:15.594235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-76127290-c0cd-479a-b3d4-9d2e86d552b7 req-969b3013-a55e-4e36-a878-5498aae89e94 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:15.595457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-76127290-c0cd-479a-b3d4-9d2e86d552b7 req-969b3013-a55e-4e36-a878-5498aae89e94 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:15.620137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-76127290-c0cd-479a-b3d4-9d2e86d552b7 req-969b3013-a55e-4e36-a878-5498aae89e94 service nova] Creating event network-changed:f8e5a3ed-229c-4186-8197-286fa9b6a050 for instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b on hv-cinder-85752 Sep 15 00:49:15.637632 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-76127290-c0cd-479a-b3d4-9d2e86d552b7 req-969b3013-a55e-4e36-a878-5498aae89e94 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077314 Sep 15 00:49:15.638607 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 276/577] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:49:15.781537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:15.782355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:15.790884 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:15.791845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:15.792580 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:15.794225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:15.794859 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:15.795458 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:16.061070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:16.072758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4d47b0cc-dc2e-4ce5-9b79-84661604e9c1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.294908 Sep 15 00:49:16.077831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 302/578] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:15 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:16.486663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:16.487508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:16.494403 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:16.495019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:16.495586 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:16.496376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:16.496838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:16.497263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:16.627963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:16.631757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:16.636976 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3e12a436-613f-4c4c-9678-876a5238d302 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.154768 Sep 15 00:49:16.637556 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 277/579] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:16 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:17.101073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:17.101691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:17.109270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:17.109691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:17.110127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:17.110841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:17.111366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:17.111821 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:17.254138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:17.263445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-54f91b7f-0471-4ec7-80b8-c615f70f1044 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.166283 Sep 15 00:49:17.264069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 303/580] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:17 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:17.662214 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:17.663600 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:17.682431 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:17.682928 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:17.683432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:17.684222 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:17.684686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:17.685121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:17.885723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:17.897468 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3e3e3c34-1d51-46c0-ac35-d14180edf387 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.240461 Sep 15 00:49:17.902820 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 278/581] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:17 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:18.294538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:18.299714 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:18.307747 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:18.308782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:18.309697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:18.310993 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:18.312169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:18.312854 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:18.511790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:18.524066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ffb1d61f-0b18-4ba6-873e-e9022646b30b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.239304 Sep 15 00:49:18.525008 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 304/582] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:18 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:18.922424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:18.923050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:18.929487 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:18.929973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:18.930409 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:18.931690 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:18.932146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:18.932569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:19.062935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:19.070811 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0dab09b1-d936-4c6c-9995-a089c689a190 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.152250 Sep 15 00:49:19.071511 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 279/583] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:18 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:19.548852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:19.549455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:19.556223 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:19.556716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:19.557149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:19.558002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:19.558484 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:19.558935 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:19.741732 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:19.750172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b7559af9-b029-4d8b-b2f6-747413676355 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.205430 Sep 15 00:49:19.750736 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 305/584] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:19 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:20.093219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:20.093832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:20.100315 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:20.100799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:20.101235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:20.101926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:20.102382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:20.102806 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:20.236880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:20.244529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-53818ad4-7e35-4e02-9169-1480673adaa4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.155251 Sep 15 00:49:20.245737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 280/585] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:20 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:20.774094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:20.774702 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:20.777181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:20.783561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:20.784061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:20.784497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:20.785238 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:20.785695 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:20.786120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:20.916160 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:20.918983 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:20.927526 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9a01760a-6520-4eb7-a244-1c4b98c924ae tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.157239 Sep 15 00:49:20.928351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 306/586] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:20 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:21.268573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:21.269113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:21.270929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:21.272051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=47 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:21.277916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:21.278398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:21.278838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:21.279585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:21.280043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:21.280470 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:21.413652 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:21.421458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e18bb635-0ff7-4e14-bf3b-37df135a2856 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.156745 Sep 15 00:49:21.422007 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 281/587] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:21 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:21.950060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:21.950679 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:21.958232 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:21.958728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:21.959169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:21.959919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:21.960381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:21.960810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:22.087053 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:22.095599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8dd9669b-fd4c-47e7-9b30-f4a469901118 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.149374 Sep 15 00:49:22.096161 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 307/588] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:21 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:22.444854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:22.445504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:22.451918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:22.452882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:22.453325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:22.454014 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:22.454468 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:22.454889 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:22.584737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:22.592598 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e407f915-df46-4947-b431-0fb761f3109c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.151750 Sep 15 00:49:22.593752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 282/589] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:22 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:23.118984 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:23.119639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:23.126711 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:23.127206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:23.127692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:23.128681 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:23.129143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:23.129574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:23.261759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:23.270263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9631fd41-fcc1-4f99-abfe-e1193c56e215 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.155171 Sep 15 00:49:23.270832 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 308/590] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:23 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:23.615826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:23.616438 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:23.622798 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:23.623275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:23.623737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:23.624469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:23.624918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:23.625335 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:23.755999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:23.763716 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-83bcbe2b-8b85-4d11-82c4-fca44225514e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.151660 Sep 15 00:49:23.764276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 283/591] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:23 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:24.293218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:24.293861 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:24.300430 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:24.300919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:24.301365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:24.302064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:24.302522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:24.302952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:24.429204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:24.437902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-51a78dc3-eb09-4faf-aa79-49240a1b093e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.148608 Sep 15 00:49:24.438459 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 309/592] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:24 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:24.786299 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:24.786819 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:24.793537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:24.794017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:24.794443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:24.795127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:24.796085 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:24.796536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:24.942488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:24.951119 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b6753787-c66d-489c-9846-002d3a731cea tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.168823 Sep 15 00:49:24.951720 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 284/593] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:24 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:25.462195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:25.462804 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:25.464649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=10 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:25.470943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:25.471431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:25.471890 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:25.472584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:25.473073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:25.473503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:25.604845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:25.613450 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bb5b8ea1-deea-4a5f-a914-fa80d5fb5b43 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.155096 Sep 15 00:49:25.614015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 310/594] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:25 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:25.973172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:25.973934 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:25.981198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:25.982003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:25.982437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:25.983141 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:25.983679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:25.984101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:26.119215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:26.127604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3af430be-e28a-43ed-9043-0d3a5ed48f36 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.158440 Sep 15 00:49:26.128417 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 285/595] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:25 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:26.636306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:26.637049 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:26.644797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:26.645297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:26.645743 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:26.646466 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:26.646931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:26.647361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:26.775226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:26.783308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d0cf8b13-d505-4d33-a251-2f9a7975e7a6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.150993 Sep 15 00:49:26.783908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 311/596] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:26 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:27.150606 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:27.151220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:27.157207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:27.157635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:27.158066 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:27.158756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:27.159209 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:27.159667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:27.288625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:27.296818 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a8f11d94-ecb1-48c8-8ca5-85a037af3b6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.150206 Sep 15 00:49:27.297380 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 286/597] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:27 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:27.806105 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:27.806720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:27.813111 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:27.813592 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:27.814051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:27.814740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:27.815188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:27.815652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:27.945111 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:27.954014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4bae7705-bb33-4300-99f3-29f94963c4ef tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.151751 Sep 15 00:49:27.954582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 312/598] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:27 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:28.319335 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:28.319894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:28.326508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:28.327637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:28.328100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:28.328805 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:28.329280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:28.329705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:28.466167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:28.473939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-19129118-447b-4c38-9cc8-9896f30fff37 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.158519 Sep 15 00:49:28.474506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 287/599] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:28 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:28.977557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:28.978128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:28.985288 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:28.985785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:28.986234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:28.986937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:28.987397 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:28.987857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:29.123634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:29.132367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-848566da-14e1-4c5e-aa4a-6435a9a0552b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.158710 Sep 15 00:49:29.133185 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 313/600] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:28 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:29.497999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:29.499142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:29.505821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:29.506303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:29.506739 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:29.507424 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:29.507901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:29.508322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:29.729850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:29.737445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-33e891e2-51ae-4b63-974a-f8a48800643d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.243327 Sep 15 00:49:29.738065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 288/601] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:29 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:30.169171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:30.169797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:30.178039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:30.178550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:30.178994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:30.179859 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:30.180192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:30.180622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:30.365637 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:30.373654 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b341f8bf-b508-4498-9886-0ade209d90be tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.208338 Sep 15 00:49:30.374215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 314/602] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:30 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:30.760772 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:30.761389 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:30.768285 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:30.768799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:30.769240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:30.769940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:30.770394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:30.770818 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:30.901161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:30.909805 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-382aa08e-9928-4aeb-be22-3e5664948628 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.152828 Sep 15 00:49:30.910371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 289/603] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:30 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:31.396813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:31.397432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:31.403943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:31.404433 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:31.404894 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:31.405594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:31.406055 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:31.406510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:31.538900 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:31.547672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-82ac3309-df34-4674-8bcb-3f5ca710af73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.154633 Sep 15 00:49:31.548252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 315/604] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:31 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:49:31.932637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:31.933168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:31.939637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:31.940118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:31.940552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:31.941243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:31.941695 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:31.942114 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:32.078087 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:32.085785 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-48cb46bb-470d-4f25-a3a4-5da9af364399 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.157137 Sep 15 00:49:32.086341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 290/605] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:31 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:32.574455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:32.575431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:32.586777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:32.587582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:32.588314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:32.589407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:32.590125 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:32.590794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:32.724110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:32.732579 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8a4dfda4-85d9-4d10-9094-86e37def6bab tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.164453 Sep 15 00:49:32.733360 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 316/606] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:32 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:33.109051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:33.109687 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:33.116391 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:33.116899 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:33.117377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:33.118090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:33.118542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:33.118966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:33.249972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:33.257926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fa008bf2-b664-497c-be0a-447ec71b24de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.153160 Sep 15 00:49:33.258479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 291/607] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:33 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:33.756574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:33.757185 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:33.763560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:33.764051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:33.764490 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:33.765187 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:33.765726 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:33.766163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:33.900303 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:33.909475 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-16601355-1de5-478e-b450-3142ad1579d0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.157063 Sep 15 00:49:33.910144 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 317/608] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:33 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:34.280964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:34.281636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:34.289092 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:34.289576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:34.290009 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:34.290707 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:34.291155 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:34.291614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:34.427670 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:34.435617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fc3e4e87-d4c0-40b6-a4ec-9a7498b757ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.158518 Sep 15 00:49:34.436289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 292/609] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:34 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:34.933595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:34.934146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:34.936462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:34.942150 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:34.942632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:34.943069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:34.943788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:34.944247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:34.944672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:35.082152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:35.090281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aacb80fc-0162-42b5-8a9d-9d5eb1ef83c4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.160633 Sep 15 00:49:35.090836 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 318/610] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:34 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:35.458449 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:35.459347 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:35.469615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:35.470110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:35.471066 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:35.471807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:35.472267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:35.472697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:35.609875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:35.618320 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-15b5bd9a-73a9-430c-aebc-8b75bb8ac5f2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.164157 Sep 15 00:49:35.618873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 293/611] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:35 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:36.113621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:36.114163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:36.120626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:36.121194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:36.121745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:36.122518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:36.123060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:36.123519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:36.249804 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:36.258771 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6ef34bd3-7503-4073-8763-4a3efee7265b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.149120 Sep 15 00:49:36.259341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 319/612] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:36 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:36.640593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:36.641213 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:36.647748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:36.648239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:36.648676 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:36.649380 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:36.649847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:36.650280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:36.668851 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:36.779417 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:36.787065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-28a95ff5-a7ad-4801-b8bf-d5e03eedad77 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.150326 Sep 15 00:49:36.787671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 294/613] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:36 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:37.282058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:37.282673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:37.289720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:37.290204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:37.290642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:37.291335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:37.291820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:37.292247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:37.421483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:37.429487 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b9582f50-6638-4f46-bfcf-82c81d1b4e73 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.151262 Sep 15 00:49:37.430047 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 320/614] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:37 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:37.810168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:37.810718 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:37.817510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:37.817995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:37.818435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:37.819127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:37.819618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:37.820046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:37.952178 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:37.960575 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-63194d53-3211-4f0b-9e15-3723fe61359e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.154271 Sep 15 00:49:37.961135 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 295/615] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:37 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:38.546660 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:38.547307 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:38.554103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:38.554596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:38.555027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:38.555735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:38.556193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:38.556617 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:38.688122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:38.697213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f079dba3-a334-4081-9982-5dd3e1fd2a7a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.249418 Sep 15 00:49:38.697778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 321/616] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:38 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:38.982727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:38.983337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:38.990301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:38.990807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:38.991240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:38.991961 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:38.992413 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:38.993165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:39.124154 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:39.133327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-86b7f2c6-b764-47c4-b8eb-8317c5d968c8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.154548 Sep 15 00:49:39.133951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 296/617] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:38 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:39.719117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:39.720829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:39.727632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:39.728127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:39.728771 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:39.729632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:39.730286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:39.730715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:39.864339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:39.872576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-afb31f06-65e0-429b-86b4-a5bb45942cf1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.157234 Sep 15 00:49:39.873133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 322/618] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:39 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:40.155652 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:40.156320 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:40.162540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:40.163019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:40.163456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:40.164170 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:40.164622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:40.165041 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:40.375702 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:40.384405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9601ffe3-5205-4a06-b51c-8d3e9fdf3c3e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.232635 Sep 15 00:49:40.384969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 297/619] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:40 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:40.896716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:40.898481 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:40.906646 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:40.907463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:40.908658 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:40.909698 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:40.910370 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:40.911041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:40.936058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:41.345628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:41.355858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b7c779f8-730e-4550-a919-109aca589c92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.462877 Sep 15 00:49:41.356393 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 323/620] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:40 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:41.406469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:41.407082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:41.414313 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:41.415013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:41.415453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:41.416239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:41.416696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:41.417117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:41.584748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:41.592976 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-91b6b877-bcf3-49b7-a79c-35d4cc785937 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.190529 Sep 15 00:49:41.593535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 298/621] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:41 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:42.381543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:42.382267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:42.389773 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:42.390365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:42.391252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:42.391987 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:42.393036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:42.393588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:42.603862 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:42.617709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5a581a19-b64b-4a5b-825d-42a38184637d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.240078 Sep 15 00:49:42.621911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 324/622] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:42 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:42.622053 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:42.622053 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:42.632738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:42.633252 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:42.633692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:42.634415 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:42.634872 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:42.635302 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:42.908413 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:42.917484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d989bd9d-4f12-4451-99e0-3f37325d0674 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.300255 Sep 15 00:49:42.918066 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 299/623] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:42 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:49:43.643536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:43.645335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:43.653997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:43.654770 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:43.655376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:43.656549 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:43.657170 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:43.657966 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:43.814839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:43.830176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f0f4e285-2c03-453b-a0eb-2a3e26d6e356 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.192052 Sep 15 00:49:43.848052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 325/624] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:43 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:43.947283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:43.950151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:43.959937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:43.960908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:43.961834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:43.962801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:43.963558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:43.964218 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:44.193749 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:44.202097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-702a3801-da21-43ac-9bf7-0bc89718ce79 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.265063 Sep 15 00:49:44.202730 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 300/625] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:43 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:44.854207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:44.855533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:44.865608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:44.866112 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:44.866550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:44.867289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:44.867775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:44.868201 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:45.018001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:45.034176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5fab9da9-b29e-4d02-b0c5-6bf005283c1f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.183759 Sep 15 00:49:45.035435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 326/626] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:44 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:45.224585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:45.225207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:45.231896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:45.232434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:45.232930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:45.233648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:45.234113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:45.234581 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:45.424999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:45.432847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-eeb00c07-9ac3-46ce-b6ac-a7b2857b1c30 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.212089 Sep 15 00:49:45.433485 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 301/627] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:45 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:46.059827 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:46.060439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:46.073088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:46.083236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:46.085841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:46.086949 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:46.087608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:46.089524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:46.457372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:46.458658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:46.466032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:46.467204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:46.469093 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:46.469339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:46.470924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:46.474830 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:46.475865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:46.489123 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-98a1b7f0-7882-4cdf-87ae-04967d0bbde0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.433016 Sep 15 00:49:46.506113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 327/628] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:46 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:46.672327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:46.683203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e3f91bf2-2be3-439c-912a-99d91097cbe7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.230190 Sep 15 00:49:46.690298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 302/629] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:46 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:49:47.515783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:47.516503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:47.526353 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:47.526853 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:47.527292 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:47.528038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:47.528495 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:47.528920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:47.713276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:47.715277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:47.723837 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:47.725149 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:47.725767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:47.727118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:47.728305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:47.728906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:47.790497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:47.808944 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0a20e968-dbca-4efe-b4ef-71ba06329d71 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.297241 Sep 15 00:49:47.810424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 328/630] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:47 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:48.041301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:48.062195 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f49a389a-50e4-43c4-8a61-1ba7531c30de tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.353360 Sep 15 00:49:48.063673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 303/631] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:47 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:49:48.836992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:48.837532 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:48.849921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:48.850997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:48.851669 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:48.852624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:48.853300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:48.853956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:49.068628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:49.089409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dbb5a32b-b696-4e81-8614-928af0135bd5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1720 microversion: 2.1 time: 0.247547 Sep 15 00:49:49.089409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 329/632] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:48 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:49.094525 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:49.095865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:49.099520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 00:49:49.099691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Thu Sep 15 00:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b (ip 10.222.0.15) !!! Sep 15 00:49:49.104933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:49.105831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:49.106487 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:49.107399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:49.108080 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:49.108692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:49.320392 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:49.334125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0af26232-7346-4703-a212-bc1d05a04811 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.242586 Sep 15 00:49:49.348950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 304/633] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:49 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:50.104974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:50.105583 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:50.112278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:50.112996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:50.113430 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:50.114330 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:50.114943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:50.115549 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:50.258110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:50.266921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c754292c-1f3e-465f-a937-8986a3fa13a8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1697 microversion: 2.1 time: 0.165601 Sep 15 00:49:50.267687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 330/634] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:50 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:50.291898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ec17a6f0-3d61-4a86-a0a4-1fc0c487ceda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:50.303824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ec17a6f0-3d61-4a86-a0a4-1fc0c487ceda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:50.304647 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ec17a6f0-3d61-4a86-a0a4-1fc0c487ceda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:50.305445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ec17a6f0-3d61-4a86-a0a4-1fc0c487ceda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:50.366965 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:50.367624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:50.372523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ec17a6f0-3d61-4a86-a0a4-1fc0c487ceda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Going to try to start instance {{(pid=127200) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 00:49:50.375701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:50.377306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:50.378386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:50.379118 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:50.379800 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:50.380404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:50.429374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ec17a6f0-3d61-4a86-a0a4-1fc0c487ceda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/action" status: 202 len: 0 microversion: 2.1 time: 0.142495 Sep 15 00:49:50.430799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 305/635] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:49:50 2022] POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:49:50.454414 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:50.455448 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:50.463572 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:50.464621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:50.465309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:50.466382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:50.467053 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:50.467882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:50.610378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:50.618640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2b8c8ade-a87b-437c-9074-deb42fb7cb07 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.258079 Sep 15 00:49:50.633012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 331/636] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:50 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:49:50.640429 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:50.651531 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4fe6aa25-f090-4626-9669-1aa99605c6d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1706 microversion: 2.1 time: 0.212279 Sep 15 00:49:50.651531 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 306/637] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:50 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1706 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:51.644504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:51.645440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:51.658903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:51.659827 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:51.660499 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:51.661531 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:51.662213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:51.662875 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:51.680305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:51.680960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:51.686988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=52 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:51.688960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:51.689586 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:51.690037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:51.690751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:51.695218 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:51.695735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:51.848321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:51.856683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0a926642-7f8a-4005-ab0c-c9db7b3aa9ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.217366 Sep 15 00:49:51.860017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 332/638] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:51 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:51.911872 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:51.920394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-40c25b12-09c2-43f6-b621-43ef216acfb2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1706 microversion: 2.1 time: 0.249134 Sep 15 00:49:51.928988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 307/639] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:51 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1706 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:52.889633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:52.900043 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:52.914611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:52.915107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:52.924704 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:52.925745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:52.926379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:52.927008 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:52.944485 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:52.945773 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:52.978753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:52.979543 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:52.980171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:52.981060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:52.981512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:52.982112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:53.107584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:53.123257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c5f33cab-ec68-4ba8-850e-4c03056e0042 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.242254 Sep 15 00:49:53.132346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 333/640] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:52 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:53.164210 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:53.174123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c66678ec-e832-4ffe-8ee2-0450bfcd2abe tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1706 microversion: 2.1 time: 0.233369 Sep 15 00:49:53.174721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 308/641] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:52 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1706 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:54.155558 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:54.156944 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:54.176642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:54.177413 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:54.178066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:54.181587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:54.182951 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:54.184937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:54.199680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:54.200946 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:54.213205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:54.213702 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:54.214155 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:54.214874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:54.215343 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:54.216224 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:54.456310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:54.472250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-38e7d4db-86c2-4a20-95eb-69687cef694e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1706 microversion: 2.1 time: 0.278195 Sep 15 00:49:54.474690 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 309/642] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:54 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1706 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:54.557918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:54.568901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e7336c24-31fc-4817-9068-036e53875c7f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.418531 Sep 15 00:49:54.580616 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 334/643] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:54 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:55.099516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-932256560", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-309604362", "security_groups": [{"name": "tempest-secgroup-smoke-305757992"}], "block_device_mapping_v2": [{"uuid": "96fc9de6-4298-4b9e-b043-b5167658344e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0487b0cb-031a-4188-bee6-95c6ebd2b4a3"}]}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:55.261626 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] validate_networks() for [('0487b0cb-031a-4188-bee6-95c6ebd2b4a3', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:49:55.499851 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:55.501712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:55.509658 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:55.510774 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:55.511431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:55.512445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:55.513684 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:55.515353 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:55.772403 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:55.799554 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4b68ada7-e856-46f9-a54f-eecbfe988463 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1706 microversion: 2.1 time: 0.303455 Sep 15 00:49:55.800584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 335/644] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:55 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1706 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:49:55.826975 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:55.828048 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:55.841179 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:55.842798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:55.844008 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:55.845476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:55.848100 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:55.848889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:55.910601 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:49:55.911027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:49:55.911539 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:49:55.911936 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:49:55.912347 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:49:55.926867 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:55.931215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:55.932149 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:55.933135 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:55.933768 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:55.934653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:55.953567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:55.969961 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Getting quotas for project 53d8d76185c44a159439c0f7a0e88b31. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:49:55.975802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Getting quotas for user d308262224af475091e6aa494ea839b1 and project 53d8d76185c44a159439c0f7a0e88b31. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:49:56.083101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:49:56.086078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96fc9de6-4298-4b9e-b043-b5167658344e',volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:49:56.119848 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:56.134115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b4ddab36-d666-4cd0-9274-70d0f759121f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.332281 Sep 15 00:49:56.134957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 336/645] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:55 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:56.320101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ff3371de-5faf-4502-a055-52e1d7405035 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.224406 Sep 15 00:49:56.321721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 310/646] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:49:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:49:56.335741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-207ba69e-7e55-4c39-97f1-15a8d87a859f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:56.336369 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-207ba69e-7e55-4c39-97f1-15a8d87a859f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:56.426958 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-207ba69e-7e55-4c39-97f1-15a8d87a859f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:56.435062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-207ba69e-7e55-4c39-97f1-15a8d87a859f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1093 microversion: 2.1 time: 0.105166 Sep 15 00:49:56.445020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 337/647] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:56 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1093 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:56.830159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:56.831084 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:56.837607 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:56.838398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:56.839083 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:56.840038 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:56.840777 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:56.841560 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:56.992714 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:57.004594 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7cb9e56c-faa7-41b5-be82-132d90713939 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1706 microversion: 2.1 time: 0.179364 Sep 15 00:49:57.005394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 311/648] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:56 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1706 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:57.159637 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:57.160182 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:57.167784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:57.168390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:57.168906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:57.169709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:57.170269 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:57.170801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:57.317871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:57.326278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d065b897-8c32-47cf-9c58-6073b26ebec8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.170914 Sep 15 00:49:57.335651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 338/649] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:57 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:57.466231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:57.467388 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:57.474950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:57.475725 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:57.476351 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:57.482683 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:57.483356 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:57.483996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:57.552019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:57.560785 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ad5063f6-59c0-4294-a801-7ccaae37b94a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1143 microversion: 2.1 time: 0.104441 Sep 15 00:49:57.561433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 312/650] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:57 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1143 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:58.029103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:58.029881 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:58.036358 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:58.036860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:58.037302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:58.038002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:58.041536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:58.041536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:58.184952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:58.193975 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b0c782dc-c03d-4f74-99cc-a69a9ba29956 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1706 microversion: 2.1 time: 0.168789 Sep 15 00:49:58.194860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 339/651] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:58 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1706 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:58.351298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:58.351935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:58.358373 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:58.358861 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:58.359288 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:58.360664 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:58.361288 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:58.361879 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:58.533320 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:58.544109 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-89d8300b-6024-42e0-b407-bac159d9c5b7 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.197098 Sep 15 00:49:58.559935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 313/652] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:58 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:58.584264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:58.584993 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:58.592132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:58.592918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:58.593594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:58.595090 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:58.595804 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:58.596369 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:58.658808 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:58.667218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-89fe0300-b592-4e4d-b6a6-7c037eec5332 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1143 microversion: 2.1 time: 0.086751 Sep 15 00:49:58.668312 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 340/653] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:58 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:59.219127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:59.219815 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:59.232528 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:59.233538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:59.234123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:59.235790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:59.236458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:59.237081 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:59.380613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:59.389397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4b851a90-d528-4019-9b70-3fb52fa435f5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1706 microversion: 2.1 time: 0.175143 Sep 15 00:49:59.390503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 314/654] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:59 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1706 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:59.569897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:59.571175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:59.579628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:59.580221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:59.580866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:59.581640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:59.582467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:59.583161 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:59.629042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:59.693945 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:49:59.695345 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:49:59.701534 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:59.702458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:59.703355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:59.705073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:59.706399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:59.707118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:59.786651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:59.795208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-23851287-259e-40e5-b5f1-c20d88e6d78c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.232810 Sep 15 00:49:59.798060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 341/655] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:59 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:49:59.803425 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-2d6e3b61-4e61-4db9-9c9e-8bf271f89c44 req-77421cd0-0571-4432-af40-f00a0e045f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c94a4-c708-4b2f-b8b1-fa336f60aa4b", "name": "network-vif-plugged", "status": "completed", "tag": "f8e5a3ed-229c-4186-8197-286fa9b6a050"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:49:59.817712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2d6e3b61-4e61-4db9-9c9e-8bf271f89c44 req-77421cd0-0571-4432-af40-f00a0e045f57 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:49:59.819188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2d6e3b61-4e61-4db9-9c9e-8bf271f89c44 req-77421cd0-0571-4432-af40-f00a0e045f57 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:49:59.819942 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2d6e3b61-4e61-4db9-9c9e-8bf271f89c44 req-77421cd0-0571-4432-af40-f00a0e045f57 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:49:59.834276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-2d6e3b61-4e61-4db9-9c9e-8bf271f89c44 req-77421cd0-0571-4432-af40-f00a0e045f57 service nova] Creating event network-vif-plugged:f8e5a3ed-229c-4186-8197-286fa9b6a050 for instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b on hv-cinder-85752 Sep 15 00:49:59.837984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:49:59.841001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-2d6e3b61-4e61-4db9-9c9e-8bf271f89c44 req-77421cd0-0571-4432-af40-f00a0e045f57 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041368 Sep 15 00:49:59.843376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 342/656] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:49:59.848697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8586e36e-693e-4b0c-9c88-5ac0a4c2e57d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1191 microversion: 2.1 time: 0.159382 Sep 15 00:49:59.849277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 315/657] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:49:59 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1191 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:00.416070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:00.418112 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:00.426039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:00.426618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:00.427127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:00.427968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:00.428511 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:00.428939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:00.593056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:00.605795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-22a34592-fceb-4064-a0ca-f55c12ae2c4f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1710 microversion: 2.1 time: 0.194046 Sep 15 00:50:00.606872 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 343/658] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:00 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1710 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:00.831654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:00.832699 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:00.841397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:00.842223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:00.843156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:00.844752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:00.845653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:00.846360 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:00.872835 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:00.873797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:00.882292 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:00.883381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:00.886209 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:00.888223 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:00.889059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:00.890107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:00.959214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:00.967755 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-df87e82a-7348-4827-92f6-9b8dfca3b814 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1191 microversion: 2.1 time: 0.098708 Sep 15 00:50:00.968932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 344/659] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:00 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:01.022284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:01.030530 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-996a1282-4f55-4b42-b16f-f6cf19f24c5d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.208708 Sep 15 00:50:01.033298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 316/660] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:00 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:01.451182 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-44da07c2-f887-441e-9fc0-ec7c08dae31d tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Action: 'create', calling method: .version_select at 0x7f2f1d0b45e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-572765165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPZRCh/gdSb8Fk8xsICMCXNvYC5V9T6Q0O1J02XoGG012dCJCNZxjrx6wKIrQvsgL306t9qdpcHGfaqSS6KIpUQNZ8bgWnfjFX0SEdtG7UhZ2STjcU9i2MzZVvLCBwB+Q=="}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:01.466624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-44da07c2-f887-441e-9fc0-ec7c08dae31d tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Getting quotas for project 762beb87caad4aa691528a7d9de01086. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:50:01.471306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-44da07c2-f887-441e-9fc0-ec7c08dae31d tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Getting quotas for user 5d47be4ab52f4034ac09fbf043990709 and project 762beb87caad4aa691528a7d9de01086. Resources: {'key_pairs'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:50:01.493371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-44da07c2-f887-441e-9fc0-ec7c08dae31d tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045901 Sep 15 00:50:01.493962 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 345/661] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:50:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:01.545385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1481021688", "imageRef": "36e82eb1-5a34-450c-a77d-73020e6e9ef6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-572765165", "networks": [{"uuid": "6527e211-69f5-4bda-8984-4ee4af88ebfb"}]}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:01.596267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] validate_networks() for [('6527e211-69f5-4bda-8984-4ee4af88ebfb', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:50:01.954488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:50:01.954978 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:50:01.955380 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:50:01.955838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:50:01.956250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:50:01.964793 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:01.965278 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:01.965722 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:01.966454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:01.966940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:01.967367 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:01.983471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Getting quotas for project 762beb87caad4aa691528a7d9de01086. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:50:01.987650 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Getting quotas for user 5d47be4ab52f4034ac09fbf043990709 and project 762beb87caad4aa691528a7d9de01086. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:50:01.991038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:01.991684 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:01.997549 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:01.998037 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:01.998474 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:01.998582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:50:01.999168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:01.999653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:02.000083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:02.001358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='36e82eb1-5a34-450c-a77d-73020e6e9ef6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:50:02.048094 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a9faca90-f8ff-4699-aa57-d1ed61ca0970 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505744 Sep 15 00:50:02.048739 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 317/662] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:50:02.059671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:02.060272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:02.065793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:02.067524 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:02.068032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:02.068906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:02.069341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:02.070390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:02.070847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:02.074679 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d7a1ab63-ce5e-4d13-a427-d9088a9b0950 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1199 microversion: 2.1 time: 0.087858 Sep 15 00:50:02.087873 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 346/663] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:01 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:02.095335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-958d5d8d-6477-445a-9c63-c059cf195eb0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:02.096109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-958d5d8d-6477-445a-9c63-c059cf195eb0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:02.155335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-958d5d8d-6477-445a-9c63-c059cf195eb0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:02.162846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-958d5d8d-6477-445a-9c63-c059cf195eb0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1258 microversion: 2.1 time: 0.073858 Sep 15 00:50:02.163655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 347/664] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:02 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:02.210206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:02.217847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7b5c2d9e-705b-4d1e-aab2-dd685ebbd88b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.161818 Sep 15 00:50:02.218406 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 318/665] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:02 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:03.101256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:03.101806 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:03.108338 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:03.108825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:03.109260 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:03.109957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:03.110412 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:03.110833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:03.173799 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:03.181878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9be10fe0-15d0-40b1-b4a2-ffc2076092ad tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1199 microversion: 2.1 time: 0.084537 Sep 15 00:50:03.182433 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 348/666] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:03 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:03.185965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:03.186613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:03.193516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:03.194004 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:03.194442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:03.195138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:03.195625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:03.196056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:03.240220 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:03.240844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:03.246737 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:03.247229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:03.247712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:03.248413 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:03.248873 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:03.249306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:03.255614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:03.263164 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5d175627-979f-405d-89e8-90f32505e961 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1262 microversion: 2.1 time: 0.080980 Sep 15 00:50:03.263769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 319/667] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:03 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:03.571395 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:03.579022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0841d3eb-78a2-40ee-aef0-b57b611a457b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.342661 Sep 15 00:50:03.579594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 349/668] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:03 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:04.204697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:04.205238 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:04.211694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:04.212182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:04.212650 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:04.213344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:04.213798 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:04.214220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:04.274289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:04.282445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9787e91d-5be3-4592-9027-c04ac5cfa049 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1199 microversion: 2.1 time: 0.081189 Sep 15 00:50:04.283026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 320/669] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:04 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:04.286635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:04.287255 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:04.293786 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:04.294277 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:04.294721 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:04.295422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:04.295924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:04.296350 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:04.355937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:04.363375 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e6b370c1-ac0d-4529-b769-868247ba1fee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1262 microversion: 2.1 time: 0.080508 Sep 15 00:50:04.363981 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 350/670] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:04 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:04.601137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:04.601754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:04.607751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:04.608240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:04.608678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:04.609376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:04.609838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:04.610268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:04.736411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:04.744167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-dea15ba3-9e40-4395-b707-5b87b263ab85 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.146891 Sep 15 00:50:04.744730 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 321/671] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:04 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:05.304700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:05.305266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:05.307734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:05.313585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:05.314088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:05.314525 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:05.315225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:05.315715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:05.316148 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:05.377328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:05.385459 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5ba614e7-117e-4247-a599-a937c23208f3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1199 microversion: 2.1 time: 0.084715 Sep 15 00:50:05.385938 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:05.386435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 351/672] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:05 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:05.386546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:05.393253 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:05.393740 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:05.394221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:05.395057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:05.395457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:05.395898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:05.460437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:05.468336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ea2f4e36-6074-41cf-955e-2d79001dd9ba tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1262 microversion: 2.1 time: 0.086168 Sep 15 00:50:05.469444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 322/673] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:05 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:05.768086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:05.768700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:05.774606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:05.775094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:05.776099 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:05.776816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:05.777275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:05.777699 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:05.907553 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:05.915276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1741da26-eca2-45b8-90f9-cb50f258cdc8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.151695 Sep 15 00:50:05.915790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 352/674] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:05 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:06.408700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:06.409300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:06.415752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:06.416235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:06.416665 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:06.417355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:06.417804 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:06.418227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:06.477554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:06.485099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d841e11d-4007-4f5d-b5e0-fd7f3dea7579 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1199 microversion: 2.1 time: 0.080234 Sep 15 00:50:06.486010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 323/675] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:06 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:06.491736 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:06.492360 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:06.498847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:06.499337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:06.499875 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:06.501495 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:06.501959 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:06.502676 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:06.562526 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:06.570586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9e3e60f9-c6d3-4198-bbc9-e7c471d582d8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1262 microversion: 2.1 time: 0.082979 Sep 15 00:50:06.571173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 353/676] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:06 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:06.938038 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:06.938679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:06.944906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:06.945135 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:06.945568 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:06.946264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:06.946721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:06.947146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:07.073896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:07.082091 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-63062a76-6293-4c82-b592-0fb2f96868bb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.148413 Sep 15 00:50:07.082657 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 324/677] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:06 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:07.508659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:07.509219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:07.515585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:07.516228 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:07.516665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:07.517357 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:07.517810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:07.518234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:07.579708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:07.587254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-60cbb7d3-98df-44bf-8c37-22c3c96d8ee6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1199 microversion: 2.1 time: 0.082497 Sep 15 00:50:07.587849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 354/678] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:07 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:07.592474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:07.593121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:07.599541 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:07.600033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:07.600472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:07.601164 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:07.601620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:07.602044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:07.661617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:07.669108 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-04794e7b-c4c5-48c4-a633-d0fd1f9e74ee tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1262 microversion: 2.1 time: 0.080503 Sep 15 00:50:07.669684 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 325/679] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:07 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:08.105389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:08.105389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:08.110278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:08.110772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:08.111213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:08.111952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:08.112418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:08.112850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:08.350213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:08.360945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d6d9fb3e-b4a9-4216-bbc1-d2f87cc5c196 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1260 microversion: 2.1 time: 0.261211 Sep 15 00:50:08.361517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 355/680] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:08 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:08.610629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:08.612103 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:08.619548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:08.620427 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:08.620536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:08.621223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:08.621703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:08.622442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:08.692242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:08.692853 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:08.701594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:08.702084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:08.702522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:08.703306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:08.703956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:08.704554 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:08.766877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:08.773356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:08.777447 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a18dbd75-5893-42eb-9920-989933de3469 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1276 microversion: 2.1 time: 0.171007 Sep 15 00:50:08.778703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 326/681] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:08 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:08.785000 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-49c3ea2c-5764-40ba-8497-5935e2aea029 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1310 microversion: 2.1 time: 0.096507 Sep 15 00:50:08.785741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 356/682] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:08 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:09.384171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:09.384714 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:09.391540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:09.392040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:09.392478 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:09.393229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:09.393641 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:09.394092 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:09.529844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:09.539084 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-049349b7-7f49-4f08-b866-30dd8519f8b2 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1444 microversion: 2.1 time: 0.158124 Sep 15 00:50:09.539944 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 327/683] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:09 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:09.562008 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:09.563248 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:09.569759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:09.570456 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:09.570944 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:09.571716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:09.572244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:09.572673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:09.796156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:09.805783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-21e3d21f-e69f-46ae-bfc6-6947f69f1268 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1444 microversion: 2.1 time: 0.247517 Sep 15 00:50:09.807166 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 357/684] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:09 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1444 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:09.815029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:09.815928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:09.822508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:09.823242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:09.824227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:09.825363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:09.825986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:09.826761 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:09.964391 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-5dfc9d4d-23a7-46dc-8723-2e824b8428a0 req-51f0f718-3d18-4239-a058-b27dc1827faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c86872-2309-4e4c-88ad-e5b9c7166dd3", "tag": "17d11138-3b63-47b5-8935-04d6fc868545"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:09.978526 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-5dfc9d4d-23a7-46dc-8723-2e824b8428a0 req-51f0f718-3d18-4239-a058-b27dc1827faa service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:09.979229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-5dfc9d4d-23a7-46dc-8723-2e824b8428a0 req-51f0f718-3d18-4239-a058-b27dc1827faa service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:09.979910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-5dfc9d4d-23a7-46dc-8723-2e824b8428a0 req-51f0f718-3d18-4239-a058-b27dc1827faa service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:09.984937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:09.997015 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-5dfc9d4d-23a7-46dc-8723-2e824b8428a0 req-51f0f718-3d18-4239-a058-b27dc1827faa service nova] Creating event network-changed:17d11138-3b63-47b5-8935-04d6fc868545 for instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 on hv-cinder-85752 Sep 15 00:50:10.010957 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-5dfc9d4d-23a7-46dc-8723-2e824b8428a0 req-51f0f718-3d18-4239-a058-b27dc1827faa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269900 Sep 15 00:50:10.014736 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 328/685] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:10.026150 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:10.027777 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:10.037247 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:10.038859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:10.039503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:10.042629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:10.043548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:10.044919 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:10.138596 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:10.143271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:10.151578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ca0c423f-f92e-4568-80bc-e8d7f28981cf tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.341845 Sep 15 00:50:10.152362 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 358/686] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:09 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:10.154937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e48148a4-ca44-4f3a-b196-98b8c78fec51 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1316 microversion: 2.1 time: 0.135099 Sep 15 00:50:10.155818 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 329/687] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:10 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:11.176274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:11.176991 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:11.186356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:11.186844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:11.187285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:11.189122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:11.189963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:11.190723 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:11.242921 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:11.246113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:11.258411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:11.266139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:11.266831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:11.267881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:11.268494 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:11.269074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:11.474623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:11.484008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-38c85541-cb3c-47ce-9670-c7d8d39c4d6c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.245497 Sep 15 00:50:11.485808 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 330/688] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:11 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:11.491229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:11.492062 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:11.499043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:11.500046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:11.501047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:11.502152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:11.503249 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:11.503955 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:11.687183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lazy-loading 'services' on Instance uuid f997b231-b0b5-469a-813f-00fda0f634a1 {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:50:11.758379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:11.767022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e90584ff-3c14-41ed-973c-bf645e5cd08b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.595282 Sep 15 00:50:11.767983 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 359/689] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:11 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:11.824588 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-53b04912-18f7-4fef-8443-518c8d8a83f1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1/os-volume_attachments/209e6b11-2700-4721-ba94-87692a8a9a5e" status: 202 len: 0 microversion: 2.1 time: 0.337078 Sep 15 00:50:11.825918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 331/690] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:50:11 2022] DELETE /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1/os-volume_attachments/209e6b11-2700-4721-ba94-87692a8a9a5e => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:50:12.510214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:12.510841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:12.513047 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=8 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:12.520722 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:12.521455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:12.522058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:12.522976 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:12.523612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:12.524415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:12.542106 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:12.549136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=4 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:12.550106 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=12 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:12.554540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-a346cecf-1e57-492c-800b-0271650c1966 req-e3b49f65-f629-43dd-a88e-cc3c4ba8b61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58c94a4-c708-4b2f-b8b1-fa336f60aa4b", "tag": "f8e5a3ed-229c-4186-8197-286fa9b6a050"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:12.566145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a346cecf-1e57-492c-800b-0271650c1966 req-e3b49f65-f629-43dd-a88e-cc3c4ba8b61e service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:12.566623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a346cecf-1e57-492c-800b-0271650c1966 req-e3b49f65-f629-43dd-a88e-cc3c4ba8b61e service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:12.567051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a346cecf-1e57-492c-800b-0271650c1966 req-e3b49f65-f629-43dd-a88e-cc3c4ba8b61e service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:12.578534 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-a346cecf-1e57-492c-800b-0271650c1966 req-e3b49f65-f629-43dd-a88e-cc3c4ba8b61e service nova] Creating event network-changed:f8e5a3ed-229c-4186-8197-286fa9b6a050 for instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b on hv-cinder-85752 Sep 15 00:50:12.584191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-a346cecf-1e57-492c-800b-0271650c1966 req-e3b49f65-f629-43dd-a88e-cc3c4ba8b61e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035159 Sep 15 00:50:12.584339 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 332/691] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:12.663831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:12.672569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-adb23c32-b448-4125-a825-0e98f3b29b2e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.165607 Sep 15 00:50:12.673254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 360/692] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:12 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:12.792366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:12.793460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:12.801044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:12.802081 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:12.802762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:12.803613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:12.804296 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:12.804979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:12.947839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:12.955613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-50b8115a-55cc-4798-abc8-212dca8179d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.167889 Sep 15 00:50:12.956497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 333/693] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:12 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:13.696728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:13.697350 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:13.704859 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:13.705351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:13.705799 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:13.706508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:13.706970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:13.707402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:13.875605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:13.883668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8a9ae789-dd71-46d4-a499-530709b696c7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.190894 Sep 15 00:50:13.884247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 361/694] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:13 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:13.978242 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:13.978846 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:13.985172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:13.985651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:13.986084 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:13.986788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:13.987239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:13.987770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:14.140051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:14.148626 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-16f571b0-48d4-4850-a3c5-08d95fff4957 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.174155 Sep 15 00:50:14.151874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 334/695] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:13 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:14.908989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:14.910362 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:14.918862 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:14.919372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:14.919854 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:14.920841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:14.921510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:14.922107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:15.055760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:15.063397 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c666e441-973a-4060-84a1-7d31ecc5502c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.158947 Sep 15 00:50:15.063994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 362/696] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:14 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:15.172543 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:15.173121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:15.179538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:15.180033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:15.180468 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:15.181162 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:15.181620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:15.182049 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:15.313686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:15.321301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-eacffcd3-ba83-4836-9270-f4a93c5a805e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.152722 Sep 15 00:50:15.321875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 335/697] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:15 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:16.086481 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:16.087088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:16.093936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:16.094416 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:16.094852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:16.095564 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:16.096036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:16.096442 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:16.236841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:16.245382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-78f979c2-336a-48cb-8346-5a936db68a24 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.162655 Sep 15 00:50:16.246567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 363/698] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:16 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:16.345475 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:16.346045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:16.352636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:16.353123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:16.353558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:16.354252 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:16.354710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:16.355130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:16.486706 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:16.494245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-78a8d905-598b-4782-8003-fa2d0bec8ad1 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.153338 Sep 15 00:50:16.494800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 336/699] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:16 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:17.268407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:17.269017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:17.275454 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:17.276039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:17.276488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:17.277199 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:17.277762 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:17.278197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:17.402838 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:17.410899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1e8d746c-5fab-4ba3-b6c7-675a1a58a2cd tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.146384 Sep 15 00:50:17.411465 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 364/700] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:17 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:17.518781 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:17.519339 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:17.526302 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:17.526796 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:17.527240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:17.527983 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:17.528448 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:17.529117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:17.659857 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:17.667464 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-53277001-768a-4005-922d-70586e09e50c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.152777 Sep 15 00:50:17.668055 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 337/701] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:17 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:18.434672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:18.435345 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:18.441977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:18.442468 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:18.442906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:18.443643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:18.444100 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:18.444526 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:18.579745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:18.587367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-91c3bc7c-2224-484d-a916-3a754bfd2f6a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.156624 Sep 15 00:50:18.587966 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 365/702] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:18 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:18.690951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:18.692522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:18.700908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:18.701759 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:18.702549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:18.703564 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:18.704332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:18.704989 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:18.846874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:18.854473 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-432d6803-2eac-45e9-812f-a82509da3ae9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.168151 Sep 15 00:50:18.855033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 338/703] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:18 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:19.610158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:19.611573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:19.618521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:19.619351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:19.620065 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:19.621009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:19.621688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:19.622181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:19.757707 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:19.765972 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e4b9cd46-8893-4773-b4f5-97ae80df2d87 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.158991 Sep 15 00:50:19.766531 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 366/704] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:19 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:19.882082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:19.882692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:19.889555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:19.890729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:19.891088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:19.891907 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:19.892363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:19.892840 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:20.048374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:20.056259 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4777097c-e350-4a82-9196-85208eacb176 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.178020 Sep 15 00:50:20.067859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 339/705] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:19 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:20.788847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:20.789396 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:20.795764 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:20.796276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:20.796713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:20.797461 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:20.797865 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:20.798289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:20.955286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:20.962970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d9a6aff7-3631-4eca-b181-8d77d4d7eb7c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.178090 Sep 15 00:50:20.963620 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 367/706] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:20 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:21.080227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:21.080842 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:21.087279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:21.087797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:21.088237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:21.088930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:21.089383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:21.089808 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:21.238471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:21.246866 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ac66df9e-93fa-46ee-9151-268a874d1a44 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.170968 Sep 15 00:50:21.247443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 340/707] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:21 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:21.987011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:21.987591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:21.994453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:21.994946 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:21.995390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:21.996150 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:21.996613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:21.997042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:22.125160 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:22.132926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e7974838-6a7d-415e-b901-ff20cde20e62 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.150644 Sep 15 00:50:22.133488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 368/708] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:21 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:22.271177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:22.272580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:22.279435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:22.282246 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:22.282991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:22.283706 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:22.284703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:22.285363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:22.285795 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:22.425515 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:22.433256 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-51272247-96bc-411d-9fc2-03907024821b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.165926 Sep 15 00:50:22.433824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 341/709] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:22 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:23.155524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:23.156148 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:23.162594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:23.163078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:23.163547 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:23.164281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:23.164741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:23.165170 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:23.289001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:23.297154 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1de0c34f-7982-4927-922f-dd999129a1f9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.145592 Sep 15 00:50:23.297722 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 369/710] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:23 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:23.456153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:23.456812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:23.463226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:23.463746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:23.464180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:23.464871 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:23.465323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:23.465743 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:23.594067 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:23.601736 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a277d364-e04c-4af2-a19b-a37a2c49080d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.149506 Sep 15 00:50:23.602304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 342/711] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:23 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:24.320446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:24.320994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:24.328130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:24.328612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:24.329047 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:24.329740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:24.330196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:24.330619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:24.457957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:24.465423 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-374c8db2-c59a-44bd-b475-527949633174 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.148841 Sep 15 00:50:24.465979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 370/712] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:24 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:24.625452 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:24.626101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:24.632691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:24.633178 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:24.633618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:24.634311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:24.634799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:24.635223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:24.764691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:24.772220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1b39c4a3-4d8b-45ad-affa-967f0428941f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.151160 Sep 15 00:50:24.772778 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 343/713] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:24 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:25.487712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:25.488324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:25.494630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:25.495110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:25.495573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:25.496269 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:25.496723 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:25.497149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:25.622001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:25.630354 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b3cd7786-1f45-4321-a4f0-ddbd0eed3bc8 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.146481 Sep 15 00:50:25.630913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 371/714] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:25 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:25.794040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:25.794585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:25.800997 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:25.801480 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:25.801917 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:25.802611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:25.803064 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:25.803502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:25.929896 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:25.937975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9394bba1-1954-45f1-ae1b-893fff0a3af2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.147835 Sep 15 00:50:25.938534 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 344/715] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:25 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:26.654339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:26.654971 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:26.661734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:26.662213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:26.662649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:26.663342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:26.663838 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:26.664264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:26.793825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:26.801870 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-65e4f87b-dfb8-449a-bc58-e49794e95ce7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.151579 Sep 15 00:50:26.802440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 372/716] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:26 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:26.961551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:26.962112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:26.968422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:26.968906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:26.969340 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:26.970034 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:26.970489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:26.970915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:26.988897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:27.104292 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:27.112480 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a7f89a9d-e8a9-41fd-af3a-2b2cd4556087 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.154919 Sep 15 00:50:27.113063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 345/717] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:26 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:27.824856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:27.825507 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:27.831876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:27.832536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:27.832784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:27.833488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:27.833948 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:27.834377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:27.962886 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:27.970920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4e0dd865-2a24-4161-ae39-c4c63bd5aaa7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.149873 Sep 15 00:50:27.971567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 373/718] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:27 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:28.136322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:28.136933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:28.143247 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:28.143761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:28.144201 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:28.144907 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:28.145341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:28.145763 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:28.272930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:28.281212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-cc5ab7cf-a7f0-4e8b-862e-e065be7478a2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.148087 Sep 15 00:50:28.281783 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 346/719] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:28 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:28.994622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:28.995565 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:29.003185 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:29.003716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:29.004167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:29.004883 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:29.005344 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:29.005778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:29.248373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:29.257864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ce82441d-c838-40f1-896c-2b835773ef86 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.267516 Sep 15 00:50:29.258502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 374/720] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:28 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:29.278280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-0c3652bc-16d9-41e3-89a6-07d20ab70840 req-7929135d-3b11-47d9-9d99-c95b29c1249d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adedf981-66a2-455b-8192-1852eea1312b", "tag": "cc2b33ab-216b-4ead-83c4-eee6a3d2ec41"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:29.288517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-0c3652bc-16d9-41e3-89a6-07d20ab70840 req-7929135d-3b11-47d9-9d99-c95b29c1249d service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:29.289019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-0c3652bc-16d9-41e3-89a6-07d20ab70840 req-7929135d-3b11-47d9-9d99-c95b29c1249d service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:29.289441 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-0c3652bc-16d9-41e3-89a6-07d20ab70840 req-7929135d-3b11-47d9-9d99-c95b29c1249d service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:29.303604 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:29.304215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:29.313341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:29.313761 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:29.314207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:29.314924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:29.315382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:29.315874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:29.327751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-0c3652bc-16d9-41e3-89a6-07d20ab70840 req-7929135d-3b11-47d9-9d99-c95b29c1249d service nova] Creating event network-changed:cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 for instance adedf981-66a2-455b-8192-1852eea1312b on hv-cinder-85752 Sep 15 00:50:29.342016 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-0c3652bc-16d9-41e3-89a6-07d20ab70840 req-7929135d-3b11-47d9-9d99-c95b29c1249d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068268 Sep 15 00:50:29.344991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 347/721] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:29.597214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:29.606006 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a1623963-105d-457a-ab57-1b7b07ecb687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.306586 Sep 15 00:50:29.606677 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 375/722] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:29 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:29.949812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:29.950395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:29.957229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:29.957716 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:29.958148 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:29.958867 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:29.959306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:29.959754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:29.986790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:50:30.064834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a2d15d30-c09e-4bc1-8348-42e9dc5b5797 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 204 len: 0 microversion: 2.1 time: 0.119151 Sep 15 00:50:30.065598 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 348/723] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:50:29 2022] DELETE /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:50:30.073901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:30.074526 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:30.081137 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:30.082119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:30.082119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:30.082763 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:30.083222 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:30.083822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:30.210055 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:30.217615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-64c05e62-4e63-4bd1-8fda-dc5c056d13d1 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1514 microversion: 2.1 time: 0.147772 Sep 15 00:50:30.218183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 376/724] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:30 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:30.284507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:30.285627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:30.291995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:30.292479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:30.292912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:30.293606 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:30.294059 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:30.295074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:30.420268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:30.427836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8c3b1e87-7e88-42f1-8037-d0e87c5f312c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.149536 Sep 15 00:50:30.428389 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 349/725] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:30 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:30.630122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:30.630741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:30.636686 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:30.637174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:30.637611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:30.638302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:30.638760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:30.639185 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:30.641723 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:30.772066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:30.779888 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c1bc19cd-6fd8-4bcc-854d-1a91648c94e7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.153760 Sep 15 00:50:30.780451 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 377/726] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:30 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:31.240556 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:31.241172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:31.247123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:31.247639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:31.248079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:31.248774 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:31.249236 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:31.249659 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:31.378609 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:31.386786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1b216521-6201-438c-a7b0-7fe7b6e6989f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1514 microversion: 2.1 time: 0.150079 Sep 15 00:50:31.387346 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 350/727] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:31 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:31.450381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:31.451030 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:31.458415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:31.458906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:31.459355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:31.460082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:31.460543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:31.460971 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:31.585326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:31.593677 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cc615249-dc04-453f-9c64-cc8c72bad70a tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.146563 Sep 15 00:50:31.594455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 378/728] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:31 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:31.802174 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:31.802704 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:31.808645 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:31.809127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:31.809562 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:31.810254 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:31.810708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:31.811132 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:31.938491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:31.946065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-817b7064-6826-4c66-b8d8-2e5ebef7530d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.147863 Sep 15 00:50:31.946633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 351/729] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:31 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:32.466262 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:32.466878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:32.473748 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:32.474239 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:32.474683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:32.475384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:32.475874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:32.476306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:32.601569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:32.609850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f02849a1-235e-4c21-83a3-0ac8cfd6a6a8 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1514 microversion: 2.1 time: 0.147419 Sep 15 00:50:32.610423 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 379/730] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:32 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:32.616575 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:32.617191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:32.623506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:32.624037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:32.624474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:32.625168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:32.625623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:32.626063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:32.753947 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:32.761477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9d10bc4e-4a7d-4da1-a7ae-224d8a861fac tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.148697 Sep 15 00:50:32.762042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 352/731] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:32 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:32.970864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:32.971500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:32.977391 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:32.977880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:32.978319 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:32.979015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:32.979473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:32.979926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:33.111247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:33.118819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-14f82ee6-a1a4-4bc6-9be0-6f21d2f42d5f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.152453 Sep 15 00:50:33.119378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 380/732] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:32 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:33.632984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:33.633596 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:33.640157 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:33.640642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:33.641078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:33.641770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:33.642254 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:33.642677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:33.771188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:33.778873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9778b721-f983-4a34-8c1a-1bb9fe593a98 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1514 microversion: 2.1 time: 0.149719 Sep 15 00:50:33.779434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 353/733] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:33 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:33.783534 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:33.784153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:33.790229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:33.790712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:33.791148 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:33.791877 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:33.792333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:33.792755 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:33.919422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:33.927452 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3c23f3d7-8bf9-4df5-8c59-503c94560e08 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.147761 Sep 15 00:50:33.928030 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 381/734] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:33 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:34.142069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:34.142672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:34.148698 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:34.149181 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:34.149621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:34.150305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:34.150783 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:34.151203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:34.276627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:34.284886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d67c1a6d-b639-4fb6-958e-9398e587e6b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.146618 Sep 15 00:50:34.285456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 354/735] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:34 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:34.802187 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:34.802797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:34.809309 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:34.809793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:34.810226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:34.810916 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:34.811368 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:34.811826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:34.936108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:34.943591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b48af0ad-1420-487c-acdc-1002eb008b5f tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1514 microversion: 2.1 time: 0.145231 Sep 15 00:50:34.944150 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 382/736] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:34 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:34.949878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:34.950486 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:34.957006 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:34.957489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:34.957924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:34.958617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:34.959076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:34.959508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:35.307377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:35.308081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:35.313939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:35.314429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:35.314868 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:35.315593 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:35.316056 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:35.316490 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:35.333611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:35.341223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d9591938-f95b-4468-a531-cb3449b4acb4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.395096 Sep 15 00:50:35.341814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 355/737] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:34 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:35.445250 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:35.453498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-83730500-8b09-4952-8884-d9c3355a2853 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.149918 Sep 15 00:50:35.454059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 383/738] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:35 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:35.966082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:35.966697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:35.973198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:35.973680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:35.974113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:35.974806 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:35.975286 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:35.975748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:36.111977 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:36.119787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-02fcd62f-f27c-44ec-979c-4d10a96f23bf tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1514 microversion: 2.1 time: 0.157487 Sep 15 00:50:36.120365 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 356/739] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:35 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:36.364700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:36.365317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:36.367674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=66 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:36.372789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:36.373286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:36.373729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:36.374453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:36.374913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:36.375340 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:36.480713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:36.481431 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:36.487958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:36.488444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:36.488881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:36.489578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:36.490037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:36.490461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:36.506286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:36.513932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-139f0234-6c58-4a9c-aa81-d507503b39d4 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.153084 Sep 15 00:50:36.515393 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 384/740] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:36 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:36.636629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:36.645140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-653437a5-9ec5-4015-8890-c267ef3f718b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.168144 Sep 15 00:50:36.656440 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 357/741] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:36 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:37.143365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:37.144882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:37.150772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:37.151258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:37.151729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:37.152426 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:37.152883 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:37.153307 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:37.254423 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e4bda3331540d1a0b869270db9c25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a872cd1b1e451ba5786fe246950f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:37.262532 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-db5b4965-e3a8-4f5c-b50b-62477e72a7c2 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 200 len: 1472 microversion: 2.1 time: 0.123563 Sep 15 00:50:37.263108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 385/742] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:37 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 1472 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:37.316703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-9d365b24-f9a3-4d61-a3d2-f90ca49ab09c req-3e74ceb2-ef29-4b32-b513-bd58546ac66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f997b231-b0b5-469a-813f-00fda0f634a1", "name": "network-vif-deleted", "tag": "644d212f-2458-4aeb-a5e5-94bbe347339c"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:37.328612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9d365b24-f9a3-4d61-a3d2-f90ca49ab09c req-3e74ceb2-ef29-4b32-b513-bd58546ac66a service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:37.329086 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9d365b24-f9a3-4d61-a3d2-f90ca49ab09c req-3e74ceb2-ef29-4b32-b513-bd58546ac66a service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:37.329518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9d365b24-f9a3-4d61-a3d2-f90ca49ab09c req-3e74ceb2-ef29-4b32-b513-bd58546ac66a service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:37.341490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-9d365b24-f9a3-4d61-a3d2-f90ca49ab09c req-3e74ceb2-ef29-4b32-b513-bd58546ac66a service nova] Creating event network-vif-deleted:644d212f-2458-4aeb-a5e5-94bbe347339c for instance f997b231-b0b5-469a-813f-00fda0f634a1 on hv-cinder-85752 Sep 15 00:50:37.346950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-9d365b24-f9a3-4d61-a3d2-f90ca49ab09c req-3e74ceb2-ef29-4b32-b513-bd58546ac66a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034118 Sep 15 00:50:37.347899 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 358/743] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:37.538371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:37.539001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:37.545982 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:37.546467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:37.546899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:37.547624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:37.548082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:37.548506 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:37.668353 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:37.669136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:37.677297 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:37.678075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:37.678735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:37.679625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:37.680519 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:37.680951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:37.682241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:37.690047 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-276e5e66-1af7-40cc-b849-7f3771577b1b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.155648 Sep 15 00:50:37.690614 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 386/744] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:37 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:37.813442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:37.821204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-edd30218-7bfe-4899-91d7-6761957b398e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.157210 Sep 15 00:50:37.821844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 359/745] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:37 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:38.027564 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-a4ade402-c43b-4e9e-8627-4248e265e302 req-41b7e98f-9d01-48e7-b526-8e11aba7ac53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adedf981-66a2-455b-8192-1852eea1312b", "name": "network-vif-plugged", "status": "completed", "tag": "cc2b33ab-216b-4ead-83c4-eee6a3d2ec41"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:38.041758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a4ade402-c43b-4e9e-8627-4248e265e302 req-41b7e98f-9d01-48e7-b526-8e11aba7ac53 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:38.042271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a4ade402-c43b-4e9e-8627-4248e265e302 req-41b7e98f-9d01-48e7-b526-8e11aba7ac53 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:38.042716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-a4ade402-c43b-4e9e-8627-4248e265e302 req-41b7e98f-9d01-48e7-b526-8e11aba7ac53 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:38.055366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-a4ade402-c43b-4e9e-8627-4248e265e302 req-41b7e98f-9d01-48e7-b526-8e11aba7ac53 service nova] Creating event network-vif-plugged:cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 for instance adedf981-66a2-455b-8192-1852eea1312b on hv-cinder-85752 Sep 15 00:50:38.060475 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-a4ade402-c43b-4e9e-8627-4248e265e302 req-41b7e98f-9d01-48e7-b526-8e11aba7ac53 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109310 Sep 15 00:50:38.061271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 387/746] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:38.286880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:38.287402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] [instance: f997b231-b0b5-469a-813f-00fda0f634a1] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:38.293576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:38.294215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:38.294724 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:38.295648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:38.296139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:38.296570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:38.310277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] HTTP exception thrown: Instance f997b231-b0b5-469a-813f-00fda0f634a1 could not be found. Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Request method failure captured: Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 HTTP/1.1 Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInXrjxUhnzWsqXPquUW0aqWuOJ4guwldoCg4WA8ppXAFBspZEiv0y10rUxp7q2jfcD-WJobxzJ9nmXdAGPH46InGvWSgvuUNo3N8GdjAqZKDCbVwv0UW95S0nbugA6df_bDdKkX_6xRLaORfDbo_GUzaBWfnYSnjI_Pjmc_JvVA-9oE Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 39a872cd1b1e451ba5786fe246950f73 Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1280686874 Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:50:38.311966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a872cd1b1e451ba5786fe246950f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_39a872cd1b1e451ba5786fe246950f73", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/39a872cd1b1e451ba5786fe246950f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/39a872cd1b1e451ba5786fe246950f73"}]}] Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-VolumesSnapshotTestJSON-1280686874 Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 39a872cd1b1e451ba5786fe246950f73 Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1280686874 Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-VolumesSnapshotTestJSON-1280686874-project Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: b8e4bda3331540d1a0b869270db9c25d Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-VolumesSnapshotTestJSON-1280686874-project Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance f997b231-b0b5-469a-813f-00fda0f634a1 could not be found. Sep 15 00:50:38.313512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': 'f997b231-b0b5-469a-813f-00fda0f634a1'} Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f997b231-b0b5-469a-813f-00fda0f634a1 could not be found. Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:50:38.314326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f997b231-b0b5-469a-813f-00fda0f634a1 could not be found. Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f997b231-b0b5-469a-813f-00fda0f634a1 could not be found. Sep 15 00:50:38.315910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:50:38.317544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] Returning 404 to user: Instance f997b231-b0b5-469a-813f-00fda0f634a1 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:50:38.317544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7b703eba-be86-496b-8b20-973e47f9b913 tempest-VolumesSnapshotTestJSON-1280686874 tempest-VolumesSnapshotTestJSON-1280686874-project] 10.222.0.15 "GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1" status: 404 len: 111 microversion: 2.1 time: 0.030522 Sep 15 00:50:38.317544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 360/747] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:38 2022] GET /compute/v2.1/servers/f997b231-b0b5-469a-813f-00fda0f634a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:50:38.714148 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:38.714845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:38.721107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:38.721598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:38.722042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:38.722739 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:38.723194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:38.723655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:38.843934 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:38.844554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:38.850843 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:38.851331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:38.851904 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:38.852044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:38.852640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:38.853099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:38.853527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:38.859993 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-db7bed00-d55e-45da-9c1a-f58892e0da90 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.150625 Sep 15 00:50:38.860556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 388/748] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:38 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:38.985295 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:38.993370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-41522652-a211-4c57-be47-ac9c538133c7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.153239 Sep 15 00:50:38.993925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 361/749] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:38 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:39.883622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:39.884278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:39.890462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:39.891597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:39.892044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:39.892755 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:39.893294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:39.893673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:40.017946 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:40.018580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:40.026262 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:40.026766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:40.027210 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:40.027955 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:40.029421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:40.030204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:40.048038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:40.057640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fd0a40bf-e034-4bba-9e64-dc031f581604 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1358 microversion: 2.1 time: 0.177863 Sep 15 00:50:40.058216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 389/750] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:39 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:40.060247 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:40.173125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:40.180764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9110b425-ddac-4238-8136-00571559f68a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.167263 Sep 15 00:50:40.181323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 362/751] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:40 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:41.081053 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:41.081675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:41.088144 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.088635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.089075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.089778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.090233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.090659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.204160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:41.204768 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:41.210850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.211330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.211789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.212481 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.212935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.213356 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.216157 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:41.224488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-da9e0b93-c882-42e3-8c8a-cc3a2d4e4566 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1547 microversion: 2.1 time: 0.147745 Sep 15 00:50:41.225051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 390/752] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:41 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:41.246616 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:41.247225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:41.253406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.253896 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.254357 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.255064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.255537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.255967 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.344563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:41.352326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7bd13768-e569-43c7-a57a-6403df67eed4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.152488 Sep 15 00:50:41.352892 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 363/753] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:41 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:41.390236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:41.398795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a683eed4-84ef-4e72-ae30-620c6ed00e21 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1547 microversion: 2.1 time: 0.155796 Sep 15 00:50:41.399366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 391/754] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:41 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:41.421205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:41.425983 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:41.426745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Searching by: {'deleted': False, 'project_id': '762beb87caad4aa691528a7d9de01086'} {{(pid=127200) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 15 00:50:41.433316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.433790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.434223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.434949 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.435405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.435865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.523569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.multi_cell_list [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127200) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 15 00:50:41.614372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f139475c-96cd-4774-8d0f-fe188041c0b9 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196849 Sep 15 00:50:41.614880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 364/755] 10.222.0.15 () {58 vars in 1125 bytes} [Thu Sep 15 00:50:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:41.627228 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:41.627883 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:41.633717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.634198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.634635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.635332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:41.635848 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:41.636278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:41.762548 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:41.770258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e327c7db-e408-45af-92c1-505a10bacec5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1547 microversion: 2.1 time: 0.147572 Sep 15 00:50:41.770814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 392/756] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:41 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:42.374973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:42.375615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:42.382281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:42.382774 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:42.383224 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:42.383964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:42.384422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:42.384859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:42.519283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:42.526824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6ee87378-ea9a-4d95-a673-24810c4b0188 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.155790 Sep 15 00:50:42.527387 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 365/757] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:42 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:43.550599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:43.551177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:43.557600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:43.558084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:43.558528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:43.559216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:43.559705 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:43.560131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:43.690857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:43.699594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-896ddf74-700c-4be9-9917-c4d2b5a4a2af tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.153544 Sep 15 00:50:43.700227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 393/758] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:43 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:44.722285 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:44.722895 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:44.729589 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:44.730079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:44.730518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:44.731216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:44.731701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:44.732128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:44.863656 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:44.871163 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f57d058d-a1c1-4750-bbcc-7821d5a88459 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.152935 Sep 15 00:50:44.871750 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 366/759] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:44 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:45.436152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07ac5281-d3af-4cbf-b468-35ebc5f694d8"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:45.438593 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:45.444748 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:45.445247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:45.445694 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:45.446401 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:45.446871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:45.447308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:45.461410 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:45.804060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-331d598e-86e7-403b-ac91-d28e98f62f97 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "POST /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371860 Sep 15 00:50:45.804696 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 394/760] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:50:45 2022] POST /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:45.896490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:45.897100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:45.903749 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:45.904243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:45.904678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:45.905395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:45.905837 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:45.906311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:46.044023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:46.053457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3aadb0e2-a9b7-4a79-9e89-7003d1e8b073 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.160898 Sep 15 00:50:46.054033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 367/761] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:45 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:46.333536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-badb2761-32e7-439f-804e-9bc8e0fa1f63 req-8363a1f8-8510-413a-9ca8-b4453b8bdfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c86872-2309-4e4c-88ad-e5b9c7166dd3", "name": "network-vif-plugged", "status": "completed", "tag": "17d11138-3b63-47b5-8935-04d6fc868545"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:46.398902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-badb2761-32e7-439f-804e-9bc8e0fa1f63 req-8363a1f8-8510-413a-9ca8-b4453b8bdfc5 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:46.399928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-badb2761-32e7-439f-804e-9bc8e0fa1f63 req-8363a1f8-8510-413a-9ca8-b4453b8bdfc5 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:46.401117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-badb2761-32e7-439f-804e-9bc8e0fa1f63 req-8363a1f8-8510-413a-9ca8-b4453b8bdfc5 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:46.415889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-badb2761-32e7-439f-804e-9bc8e0fa1f63 req-8363a1f8-8510-413a-9ca8-b4453b8bdfc5 service nova] Creating event network-vif-plugged:17d11138-3b63-47b5-8935-04d6fc868545 for instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 on hv-cinder-85752 Sep 15 00:50:46.422453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-badb2761-32e7-439f-804e-9bc8e0fa1f63 req-8363a1f8-8510-413a-9ca8-b4453b8bdfc5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102096 Sep 15 00:50:46.423524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 395/762] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:47.080694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:47.081315 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:47.087881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:47.088371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:47.088809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:47.089508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:47.089963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:47.090389 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:47.217553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:47.225764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-94015308-aa2d-42ab-be3a-24589db111b0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.149498 Sep 15 00:50:47.226333 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 368/763] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:47 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:48.249551 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:48.250268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:48.256706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:48.257203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:48.257648 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:48.258353 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:48.258819 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:48.259256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:48.388622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:48.396260 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-04377219-dc08-44f7-99ac-3717769d16a7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.151498 Sep 15 00:50:48.396820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 396/764] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:48 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:49.419636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:49.420250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:49.427207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:49.427730 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:49.428171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:49.428872 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:49.429326 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:49.429753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:49.559708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:49.568115 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-77d9b11d-a5c6-453f-945c-508d24313959 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1264 microversion: 2.1 time: 0.152335 Sep 15 00:50:49.568685 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 369/765] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:49 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:50.508945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:50.509493 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:50.516715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:50.517195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:50.517628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:50.518313 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:50.518767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:50.519190 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:50.541392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-389e2e6c-2643-4022-b17c-6421c3557da6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/ips" status: 200 len: 152 microversion: 2.20 time: 0.036312 Sep 15 00:50:50.541969 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 397/766] 10.222.0.15 () {60 vars in 1289 bytes} [Thu Sep 15 00:50:50 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:50:50.590716 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:50.591327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:50.598701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:50.599196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:50.599672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:50.600384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:50.600844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:50.601274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:50.737507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:50.745194 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8a8d9726-6f08-4ec0-b86a-d09ebea615e9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1449 microversion: 2.1 time: 0.158367 Sep 15 00:50:50.745757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 370/767] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:50 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:50.768866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:50.769488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:50.775826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:50.776318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:50.776762 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:50.777468 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:50.777927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:50.778356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:50.921974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:50.929634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e4032716-850f-4bdb-83c2-2cd7a0d96008 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1449 microversion: 2.1 time: 0.164645 Sep 15 00:50:50.930189 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 398/768] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:50 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:50:52.622395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:52.686619 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-9991dfef-9510-4f21-b585-3d59678c515d req-32a9175e-45da-47e6-8400-aecd5d41fe04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c86872-2309-4e4c-88ad-e5b9c7166dd3", "tag": "17d11138-3b63-47b5-8935-04d6fc868545"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:52.694037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:52.698971 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9991dfef-9510-4f21-b585-3d59678c515d req-32a9175e-45da-47e6-8400-aecd5d41fe04 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:52.699455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9991dfef-9510-4f21-b585-3d59678c515d req-32a9175e-45da-47e6-8400-aecd5d41fe04 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:52.699930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-9991dfef-9510-4f21-b585-3d59678c515d req-32a9175e-45da-47e6-8400-aecd5d41fe04 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:52.714801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-9991dfef-9510-4f21-b585-3d59678c515d req-32a9175e-45da-47e6-8400-aecd5d41fe04 service nova] Creating event network-changed:17d11138-3b63-47b5-8935-04d6fc868545 for instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 on hv-cinder-85752 Sep 15 00:50:52.720136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-9991dfef-9510-4f21-b585-3d59678c515d req-32a9175e-45da-47e6-8400-aecd5d41fe04 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102026 Sep 15 00:50:52.720735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 371/769] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:53.497993 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f935e746-a07b-4da0-a608-81bf93f213ee"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:53.500473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:53.506659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:53.507139 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:53.507604 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:53.508305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:53.508766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:53.509197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:55.207653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d009e191-934a-4a35-b34b-ae30b87f71a7 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.816464 Sep 15 00:50:55.208191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 399/770] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:50:53 2022] POST /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments => generated 194 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:56.578394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:56.579124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:56.581936 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 00:50:56.582079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Thu Sep 15 00:50:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b (ip 10.222.0.15) !!! Sep 15 00:50:56.599577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:56.599577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:56.599577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:56.599577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:56.599964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:56.599964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:56.734030 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:56.737649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:56.738268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:56.744375 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9cad0147-d7de-4112-b9c7-a741ec5807be tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1593 microversion: 2.1 time: 0.170540 Sep 15 00:50:56.744952 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 372/771] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:50:56 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1593 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:50:56.755026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:56.755746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:56.756297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:56.757279 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:56.757991 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:56.758250 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:56.785504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lazy-loading 'flavor' on Instance uuid 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:50:56.983877 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e250bf59-d9e5-47dd-882c-c5a3c112208a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/action" status: 202 len: 0 microversion: 2.20 time: 0.250398 Sep 15 00:50:56.984572 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 400/772] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 15 00:50:56 2022] POST /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 00:50:56.994291 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:56.995214 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:57.001916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:57.003250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:57.004128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:57.005104 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:57.005852 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:57.006688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:57.151088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:57.159138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:57.160636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:57.161797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-27292710-71a2-446e-b8a7-92afcf6c6ec2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.172471 Sep 15 00:50:57.162664 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 373/773] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:50:56 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:50:58.189040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:58.189740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:58.197046 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:58.197547 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:58.197984 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:58.198683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:58.199137 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:58.199591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:58.415867 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:58.424625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:58.426068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:58.427239 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-815afbb3-08eb-4be4-852e-0eb31ae429f5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.242990 Sep 15 00:50:58.427987 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 401/774] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:50:58 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:50:58.597185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-6054ead1-87f6-4e07-8dc0-5bcb971dfcbd req-24bebdd7-98be-443e-8132-ea71caee02e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adedf981-66a2-455b-8192-1852eea1312b", "tag": "cc2b33ab-216b-4ead-83c4-eee6a3d2ec41"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:58.606949 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-6054ead1-87f6-4e07-8dc0-5bcb971dfcbd req-24bebdd7-98be-443e-8132-ea71caee02e7 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:58.607423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-6054ead1-87f6-4e07-8dc0-5bcb971dfcbd req-24bebdd7-98be-443e-8132-ea71caee02e7 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:58.607874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-6054ead1-87f6-4e07-8dc0-5bcb971dfcbd req-24bebdd7-98be-443e-8132-ea71caee02e7 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:58.620030 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-6054ead1-87f6-4e07-8dc0-5bcb971dfcbd req-24bebdd7-98be-443e-8132-ea71caee02e7 service nova] Creating event network-changed:cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 for instance adedf981-66a2-455b-8192-1852eea1312b on hv-cinder-85752 Sep 15 00:50:58.625195 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-6054ead1-87f6-4e07-8dc0-5bcb971dfcbd req-24bebdd7-98be-443e-8132-ea71caee02e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031677 Sep 15 00:50:58.625796 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 374/775] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:50:59.454481 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:50:59.455719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:59.464548 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:59.465105 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:59.465609 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:59.466742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:59.467505 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:59.468229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:59.670026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:59.671135 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2018014068"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:50:59.671805 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:50:59.678987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:59.679499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:59.679941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:59.680651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:50:59.681282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:50:59.681877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:50:59.687347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:59.688969 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:50:59.690213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d002be19-539b-4ef1-bb55-54ea35ba696a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.240835 Sep 15 00:50:59.691147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 402/776] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:50:59 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:50:59.815171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.network.security_group_api [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Adding security group ae1e1c03-b28b-4d7c-bcba-4af71d500af6 to port cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 Sep 15 00:51:00.123252 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6718664b-8534-4c27-896d-0e3c68e88f47 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "POST /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/action" status: 202 len: 0 microversion: 2.1 time: 0.456203 Sep 15 00:51:00.124342 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 375/777] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:50:59 2022] POST /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 00:51:00.133218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:00.133948 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:00.140557 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:00.144628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:00.147463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:00.155921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:00.164970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-fae20a65-6b36-46b6-a912-af7e8d36b43a req-f6c1460f-79fa-4287-8f20-f6c199c31706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adedf981-66a2-455b-8192-1852eea1312b", "tag": "cc2b33ab-216b-4ead-83c4-eee6a3d2ec41"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:00.165754 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:00.166316 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:00.197777 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-fae20a65-6b36-46b6-a912-af7e8d36b43a req-f6c1460f-79fa-4287-8f20-f6c199c31706 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:00.198241 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-fae20a65-6b36-46b6-a912-af7e8d36b43a req-f6c1460f-79fa-4287-8f20-f6c199c31706 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:00.198816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-fae20a65-6b36-46b6-a912-af7e8d36b43a req-f6c1460f-79fa-4287-8f20-f6c199c31706 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:00.214624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-fae20a65-6b36-46b6-a912-af7e8d36b43a req-f6c1460f-79fa-4287-8f20-f6c199c31706 service nova] Creating event network-changed:cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 for instance adedf981-66a2-455b-8192-1852eea1312b on hv-cinder-85752 Sep 15 00:51:00.224331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-fae20a65-6b36-46b6-a912-af7e8d36b43a req-f6c1460f-79fa-4287-8f20-f6c199c31706 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082462 Sep 15 00:51:00.224935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 376/778] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:51:00.362428 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:00.371171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-95df63d0-c66c-4d61-bf2d-f4eb087f79c0 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1759 microversion: 2.1 time: 0.242126 Sep 15 00:51:00.372048 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 403/779] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:00 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1759 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:00.716984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:00.717988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:00.725411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:00.726106 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:00.726702 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:00.727563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:00.728634 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:00.729050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:00.870529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:00.879118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:00.880585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:00.881731 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2b3f48ca-7e6c-403e-9105-6bcb14eebf05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.169152 Sep 15 00:51:00.882278 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 377/780] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:00 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:01.906643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:01.907260 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:01.913768 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:01.914259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:01.914702 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:01.915432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:01.915921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:01.916352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:02.041313 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:02.050001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:02.051449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:02.052652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-35c2d19d-679d-402d-9099-9211844e30af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.149956 Sep 15 00:51:02.053211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 404/781] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:01 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:03.077685 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:03.078514 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:03.085854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:03.086337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:03.086768 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:03.087527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:03.087984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:03.088411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:03.219047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:03.227153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:03.228623 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:03.229781 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-29a4aae5-07ac-49f5-94a8-6dbf45d51c7f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.156089 Sep 15 00:51:03.230331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 378/782] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:03 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:03.848398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:03.850688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:03.856873 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:03.857387 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:03.857834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:03.858543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:03.859010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:03.859445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:03.882615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lazy-loading 'flavor' on Instance uuid 583bc208-8f85-4abe-be0f-096127a8a5fb {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:51:03.981811 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=8,nova_cell1:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:04.005227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1c18d27e-6ddd-48df-b2ad-2f7809943236 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/action" status: 200 len: 32 microversion: 2.1 time: 0.161285 Sep 15 00:51:04.005769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 405/783] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:51:03 2022] POST /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 00:51:04.015913 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:04.016627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:04.022935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:04.023469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:04.024178 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:04.025033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:04.025562 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:04.026099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:04.170285 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:04.179083 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7958fcbc-bfc4-4c07-88b1-3571f5502717 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.167570 Sep 15 00:51:04.179671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 379/784] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:04 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:51:04.255598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:04.256213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:04.262529 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:04.263051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:04.263501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:04.264208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:04.264775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:04.265299 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:04.465538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:04.474209 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:04.475657 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:04.476813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-54af892e-f2d2-42f5-93ba-dc6b8ab64557 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.225972 Sep 15 00:51:04.477371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 406/785] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:04 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:05.202658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:05.203213 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:05.210090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:05.210555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:05.210987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:05.211724 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:05.212174 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:05.212592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:05.380710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:05.389263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f9e26913-ecc7-4351-9de7-86b0f7a5152d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.190511 Sep 15 00:51:05.389829 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 380/786] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:05 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:51:05.502759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:05.503367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:05.509706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:05.510196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:05.510626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:05.511322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:05.511898 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:05.512496 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:05.640858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:05.654205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:05.655943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:05.658302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-68c49927-e80f-43d5-ac4a-826b0bff4e89 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.158926 Sep 15 00:51:05.659019 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 407/787] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:05 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:06.413057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:06.413668 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:06.420289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:06.420774 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:06.421221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:06.421908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:06.422364 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:06.422790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:06.427689 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:06.552002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:06.560153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f70b0d29-1fb9-4f09-9dbf-f7c409009a92 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.150975 Sep 15 00:51:06.560717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 381/788] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:06 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:06.684893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:06.685502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:06.687891 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=48 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:06.693749 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:06.694241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:06.694684 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:06.695395 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:06.695885 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:06.696317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:06.831701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:06.839763 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:06.841211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:06.842384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6788504d-67bd-4888-959a-a56dc149a880 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.161333 Sep 15 00:51:06.842951 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 408/789] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:06 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:07.584130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:07.584742 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:07.591155 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:07.591682 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:07.592125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:07.592820 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:07.593277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:07.593704 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:07.718190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:07.726301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8bed6993-3998-4df7-917c-f7eff682e2e5 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.146062 Sep 15 00:51:07.726868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 382/790] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:07 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:07.867338 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:07.867986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:07.874339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:07.874825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:07.875261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:07.876746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:07.877207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:07.877634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:08.002833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:08.010714 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:08.012174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:08.013335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f2a1e6a8-b291-48b6-8ca9-fa451d3c9a6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.149950 Sep 15 00:51:08.013891 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 409/791] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:07 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:08.754708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:08.755325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:08.761719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:08.762203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:08.762644 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:08.763341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:08.763826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:08.764257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:08.893232 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:08.901318 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c32467e9-9344-48eb-987e-9d25d9fe12aa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.150725 Sep 15 00:51:08.901884 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 383/792] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:08 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:09.038652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:09.039236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:09.045585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:09.046107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:09.046553 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:09.047256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:09.047746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:09.048174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:09.171561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:09.179513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:09.180952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:09.182107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-449469f9-354d-4ca4-9392-85676b17e854 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.147348 Sep 15 00:51:09.182668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 410/793] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:09 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:09.926259 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:09.926812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:09.933910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:09.934398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:09.934829 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:09.935546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:09.935993 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:09.936410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:10.060636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:10.068650 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ff00d7db-ef6b-4127-9cb2-681abc6f5ea3 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.147687 Sep 15 00:51:10.069224 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 384/794] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:09 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:10.208084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:10.208619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:10.214808 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:10.215307 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:10.215776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:10.216480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:10.216943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:10.217378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:10.345399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:10.353417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:10.354861 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:10.356069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ac448b2f-7d7d-4dfb-baa8-7f01796616ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.152385 Sep 15 00:51:10.356627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 411/795] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:10 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:11.091697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:11.092308 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:11.098621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:11.099099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:11.099555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:11.100242 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:11.100689 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:11.101110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:11.228763 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:11.237373 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0bbad25e-0b60-4f42-b50a-2269c540ce9a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.149607 Sep 15 00:51:11.237933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 385/796] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:11 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:11.381589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:11.382113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:11.388531 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:11.389142 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:11.389591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:11.390302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:11.390766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:11.391202 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:11.516950 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:11.525152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:11.526589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:11.527768 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2ac535dc-464e-4955-9633-0044c9bd564b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.150176 Sep 15 00:51:11.528324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 412/797] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:11 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:12.261475 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:12.262091 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:12.269072 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:12.269556 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:12.270001 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:12.270691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:12.271147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:12.271604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:12.397069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:12.406099 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-df54ceb0-87ae-49b6-8349-cba42ef4bd37 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.148561 Sep 15 00:51:12.406673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 386/798] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:12 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:12.554130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:12.554674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:12.561115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:12.561612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:12.562055 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:12.562765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:12.563227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:12.563689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:12.692914 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:12.702351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:12.703820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:12.704978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b70884ab-b941-4fad-b968-63353eb3e6d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.154896 Sep 15 00:51:12.705529 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 413/799] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:12 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:13.429621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:13.430224 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:13.436649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:13.437130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:13.437561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:13.438246 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:13.438693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:13.439112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:13.565752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:13.573769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-26996344-ce75-4104-a1cc-4c71784e07ed tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.147985 Sep 15 00:51:13.574327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 387/800] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:13 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:13.730171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:13.730721 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:13.737122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:13.737610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:13.738052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:13.738740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:13.739197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:13.739661 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:13.864613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:13.873633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:13.875069 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:13.876249 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-936c2734-84af-4e0b-85b2-32a8c650ee2c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.150005 Sep 15 00:51:13.877551 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 414/801] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:13 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:14.597932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:14.598557 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:14.604923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:14.605406 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:14.605843 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:14.606533 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:14.606984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:14.607403 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:14.733120 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:14.741301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c457a6f5-9bf0-4794-b70c-c2680e3eec25 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.147813 Sep 15 00:51:14.741866 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 388/802] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:14 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:14.902525 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:14.903108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:14.910233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:14.910729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:14.911177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:14.911907 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:14.912550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:14.912989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:15.037251 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:15.045241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:15.046686 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:15.047888 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6f5a0934-e626-42be-b985-8ce9684d27ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1743 microversion: 2.20 time: 0.149426 Sep 15 00:51:15.048444 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 415/803] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:14 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:15.763915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:15.764520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:15.770887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:15.771369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:15.771842 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:15.772530 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:15.772983 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:15.773401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:15.898970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:15.907171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b9cd797f-e405-4441-bd83-29d685369d8e tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.146995 Sep 15 00:51:15.908196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 389/804] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:15 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:16.073925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:16.074537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:16.080862 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:16.081348 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:16.081785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:16.082474 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:16.082930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:16.083352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:16.214858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:16.223627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:16.225057 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:16.226210 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b050c535-4732-41cc-afb8-57340e737d5c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1743 microversion: 2.20 time: 0.156281 Sep 15 00:51:16.226766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 416/805] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:16 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:16.930469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:16.931079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:16.937535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:16.938025 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:16.938460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:16.939823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:16.940282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:16.940715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:17.075866 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:17.083950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-aeb2ef45-deb4-41a9-a256-753517ebea54 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.157387 Sep 15 00:51:17.084516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 390/806] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:16 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:17.251038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:17.252509 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:17.258964 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:17.259449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:17.259921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:17.260618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:17.261072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:17.261497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:17.385747 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:17.393818 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:17.395244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:17.396421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bd26dcbf-b3ef-4e7e-9c8a-c2b80f303ab1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1743 microversion: 2.20 time: 0.149230 Sep 15 00:51:17.396978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 417/807] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:17 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:18.106760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:18.107415 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:18.113891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:18.114377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:18.114814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:18.115598 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:18.116060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:18.116487 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:18.241594 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:18.249780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4de8ae6e-ddf2-4ed8-a0ce-2de96226a20d tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.146950 Sep 15 00:51:18.250342 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 391/808] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:18 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:18.422975 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:18.423683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:18.430483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:18.430979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:18.431423 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:18.432162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:18.432623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:18.433070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:18.576649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-f102b277-682e-4219-ace5-a5d32b74dc91 req-8a148040-d218-4a31-b5cd-0a0dbfe1eb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "469fcc1e-0231-4642-b72f-c2bf7fd7eb07", "name": "network-vif-plugged", "status": "completed", "tag": "86077b58-abc6-43a7-9b01-51a893794c4e"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:18.588256 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f102b277-682e-4219-ace5-a5d32b74dc91 req-8a148040-d218-4a31-b5cd-0a0dbfe1eb53 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:18.588997 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f102b277-682e-4219-ace5-a5d32b74dc91 req-8a148040-d218-4a31-b5cd-0a0dbfe1eb53 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:18.589437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f102b277-682e-4219-ace5-a5d32b74dc91 req-8a148040-d218-4a31-b5cd-0a0dbfe1eb53 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:18.602175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-f102b277-682e-4219-ace5-a5d32b74dc91 req-8a148040-d218-4a31-b5cd-0a0dbfe1eb53 service nova] Creating event network-vif-plugged:86077b58-abc6-43a7-9b01-51a893794c4e for instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 on hv-cinder-85752 Sep 15 00:51:18.607458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-f102b277-682e-4219-ace5-a5d32b74dc91 req-8a148040-d218-4a31-b5cd-0a0dbfe1eb53 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034608 Sep 15 00:51:18.608330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 392/809] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:51:18.763961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:18.772518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:18.773951 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:18.775106 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2f224f75-821a-41f2-8eb2-11ed273b2718 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1743 microversion: 2.20 time: 0.356149 Sep 15 00:51:18.775691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 418/810] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:18 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1743 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:19.274443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:19.275211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:19.281963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:19.283007 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:19.283511 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:19.284226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:19.284686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:19.285116 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:19.420284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:19.429134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a911bc33-a48e-46c8-aa13-d587cc03453c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.159666 Sep 15 00:51:19.429700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 393/811] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:19 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:19.800267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:19.800875 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:19.807296 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:19.807830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:19.808249 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:19.808945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:19.809398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:19.809823 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:19.936527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:19.945002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:19.946425 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:19.947599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b4c7f37c-0a08-4079-9913-0be07a6becc8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1743 microversion: 2.20 time: 0.151294 Sep 15 00:51:19.948150 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 419/812] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:19 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:20.452340 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:20.452945 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:20.459290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:20.459809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:20.460243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:20.460933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:20.461386 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:20.461802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:20.586564 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:20.594730 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-864cfdd5-f5a5-44a3-92c3-19ccf4b02c9c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.146327 Sep 15 00:51:20.595289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 394/813] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:20 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:20.973644 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:20.974261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:20.980908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:20.981398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:20.981836 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:20.982533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:20.982989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:20.983416 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:21.111292 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:21.119241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:21.120717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:21.121880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3958c7bd-881e-4c3a-920b-94b6ecf40425 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1743 microversion: 2.20 time: 0.152695 Sep 15 00:51:21.122439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 420/814] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:20 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:21.617558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:21.618175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:21.624522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:21.625008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:21.625449 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:21.626140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:21.626856 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:21.627816 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:21.757807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:21.765851 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-72f3eba3-1895-4db3-af09-d9fc234b6e66 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.152146 Sep 15 00:51:21.766407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 395/815] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:21 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:22.146220 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:22.146864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:22.153310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:22.153801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:22.154240 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:22.154961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:22.155424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:22.155880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:22.285830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:22.294559 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:22.296073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:22.297298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d76f242a-07ad-499d-b646-e3b4cebfb6ed tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1743 microversion: 2.20 time: 0.154966 Sep 15 00:51:22.297892 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 421/816] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:22 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:22.789589 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:22.790199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:22.796583 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:22.797097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:22.797584 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:22.798272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:22.798719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:22.799135 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:22.925652 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:22.933838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a4e13896-baac-4589-a35d-1ee287c553fc tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.148092 Sep 15 00:51:22.934408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 396/817] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:22 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:23.326464 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:23.327259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:23.333654 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:23.334173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:23.334613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:23.335317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:23.335807 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:23.336235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:23.340120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:23.478487 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:23.487833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:23.489592 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:23.490763 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a0b339a1-0480-475f-8005-f19cd39eea6e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.168201 Sep 15 00:51:23.491321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 422/818] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:23 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:23.957939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:23.958660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:23.965502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:23.966172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:23.966801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:23.967725 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:23.968479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:23.969062 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:24.134475 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:24.143822 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-be4c3d2e-429d-4a24-b07b-4d6a75c343f0 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1733 microversion: 2.1 time: 0.190019 Sep 15 00:51:24.144590 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 397/819] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:23 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:24.523130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:24.523838 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:24.530555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:24.531053 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:24.531519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:24.532418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:24.533053 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:24.533527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:24.676518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:24.685663 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:24.687376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:24.688619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-34fe8ea6-e1f9-40fc-9769-15d25aef6ef0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.169536 Sep 15 00:51:24.689583 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 423/820] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:24 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:25.168594 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:25.169394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:25.177406 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.178156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.178847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.179811 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.180462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.180937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.200045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:25.327290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:25.336959 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9f7c36ce-80aa-48c9-b37a-a176f31d75de tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1713 microversion: 2.1 time: 0.172219 Sep 15 00:51:25.337539 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 398/821] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:25 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1713 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:25.468747 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:25.469282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:25.481903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.482405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.482832 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.483560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.484021 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.484447 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.573544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] HTTP exception thrown: Cannot 'detach_volume' instance 583bc208-8f85-4abe-be0f-096127a8a5fb while it is in vm_state rescued Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Request method failure captured: Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments/f935e746-a07b-4da0-a608-81bf93f213ee HTTP/1.1 Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV5eOfxwz_L73XdSLZWs9muQNY38kG-uSkSdNdD8kYJGR4XiNtFxq0Biq3TCHGtX13rOTtMlS0D_4QILbpyxnJYCKqG4JBVLvzkCUnjXpiqmwovyYFBWquCXGGjip-3VBu43caF28c5uwRoM3euCFhr7Swgrcz6Ragt_7hg-yuoFig Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:51:25.575254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7090f91f78534107ba4b5ccd7f80e145", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7090f91f78534107ba4b5ccd7f80e145"}]}] Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 4e0e6a33679f4cac96704f71dcfa5c01 Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:51:25.576878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Cannot 'detach_volume' instance 583bc208-8f85-4abe-be0f-096127a8a5fb while it is in vm_state rescued Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'server_id': '583bc208-8f85-4abe-be0f-096127a8a5fb', 'id': 'f935e746-a07b-4da0-a608-81bf93f213ee'} Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583bc208-8f85-4abe-be0f-096127a8a5fb in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:51:25.577692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 583bc208-8f85-4abe-be0f-096127a8a5fb while it is in vm_state rescued Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 583bc208-8f85-4abe-be0f-096127a8a5fb while it is in vm_state rescued Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:51:25.579908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Returning 409 to user: Cannot 'detach_volume' instance 583bc208-8f85-4abe-be0f-096127a8a5fb while it is in vm_state rescued {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:51:25.582898 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ba56f3e8-f7dc-45e3-acf4-598583915793 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments/f935e746-a07b-4da0-a608-81bf93f213ee" status: 409 len: 152 microversion: 2.1 time: 0.112015 Sep 15 00:51:25.583608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 424/822] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:51:25 2022] DELETE /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments/f935e746-a07b-4da0-a608-81bf93f213ee => generated 152 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 00:51:25.586371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:25.587558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:25.592987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.593474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.593915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.594616 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.595079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.596520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.679648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0630bd82-fecb-4d5f-915c-3c1c309ed878 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "POST /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/action" status: 202 len: 0 microversion: 2.1 time: 0.096862 Sep 15 00:51:25.680426 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 399/823] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:51:25 2022] POST /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 00:51:25.690115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:25.691061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:25.699343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.700348 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.701115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.702215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.702924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.703596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.724156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:25.724770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:25.731165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.731883 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.732336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.733117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:25.733867 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:25.733990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:25.910806 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:25.919639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:25.921220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:25.922407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f31662bf-ac58-4b88-8c0f-9bc1d6c98ea1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.208101 Sep 15 00:51:25.923046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 400/824] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:25 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:25.963847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:25.975765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-28982556-d4f4-441a-a47e-cdd9ff2049ef tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1721 microversion: 2.1 time: 0.290887 Sep 15 00:51:25.977278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 425/825] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:25 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1721 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:26.954933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:26.956726 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:26.958723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=60 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:26.964846 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:26.965339 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:26.965776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:26.966477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:26.966964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:26.967470 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:27.000555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:27.002979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:27.010308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:27.011162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:27.012002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:27.012956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:27.013648 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:27.014299 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:27.140346 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:27.150590 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:27.156681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:27.162274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:27.162506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-17f3a58a-bef7-4f8c-a814-a719c5c8452f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.212293 Sep 15 00:51:27.164376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 401/826] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:26 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:27.195024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-46ded57e-41d1-405c-920a-ecb86dd49e22 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1721 microversion: 2.1 time: 0.198228 Sep 15 00:51:27.195659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 426/827] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:26 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:51:28.199191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:28.199876 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:28.207328 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:28.207922 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:28.208434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:28.209364 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:28.209893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:28.210423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:28.223210 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:28.224101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:28.233359 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:28.234266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:28.235074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:28.235834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:28.236542 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:28.237719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:28.367913 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:28.384939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:28.386631 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:28.387672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-99fd6212-abec-4bad-952c-d3eafc0b1d84 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.194320 Sep 15 00:51:28.403898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 402/828] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:28 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:28.405997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:28.417078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-16cf012c-8d18-43ff-b854-f6519c865843 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1721 microversion: 2.1 time: 0.202183 Sep 15 00:51:28.418143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 427/829] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:28 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:29.415426 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:29.416061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:29.424775 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:29.425257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:29.425681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:29.426370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:29.426820 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:29.427237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:29.441683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:29.442996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:29.450913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:29.451967 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:29.452828 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:29.454650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:29.456076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:29.456579 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:29.563717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:29.572887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:29.574237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:29.575399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-429e4f8c-4d0f-41d5-aadd-4957b8198d1e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.164386 Sep 15 00:51:29.576475 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 403/830] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:29 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:29.637242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:29.646130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fb40ec0d-f45b-4046-8e69-a75d821d522a tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1727 microversion: 2.1 time: 0.208965 Sep 15 00:51:29.646963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 428/831] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:29 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:29.669702 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:29.670527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:29.677754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:29.678338 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:29.678838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:29.679656 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:29.680640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:29.681146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:30.065979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7aeffcb7-295e-4089-9fe6-9f4a77a9a061 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.400478 Sep 15 00:51:30.066808 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 404/832] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 00:51:29 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-interface => generated 284 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:51:30.604492 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:30.605792 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:30.612902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:30.613400 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:30.613839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:30.614550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:30.615180 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:30.615793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:30.837206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:30.848448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:30.853826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:30.855318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-96ee6404-d1e0-418d-b43f-4fd4d344ed17 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.254643 Sep 15 00:51:30.867700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 429/833] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:30 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:31.040859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:31.041509 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:31.049013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:31.049814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:31.050835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:31.051918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:31.052533 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:31.053146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:31.149276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lazy-loading 'services' on Instance uuid c1d301ea-7505-4d72-8061-827894477da0 {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:51:31.266034 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-67d5755a-42f8-46a6-b355-78e51b4098d2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/os-volume_attachments/422f3712-297e-4ed5-845b-5d9ca1e16d99" status: 202 len: 0 microversion: 2.1 time: 0.228825 Sep 15 00:51:31.269814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 405/834] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:51:31 2022] DELETE /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/os-volume_attachments/422f3712-297e-4ed5-845b-5d9ca1e16d99 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:51:31.413608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-5d6c6cac-0c81-49b6-a463-00ce808999ce req-b7ed1c5c-cb82-4c04-b5ad-e5274ff9ee59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583bc208-8f85-4abe-be0f-096127a8a5fb", "tag": "d0e29cfb-c141-4cd4-ab78-e1b32fb810ef"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:31.430411 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5d6c6cac-0c81-49b6-a463-00ce808999ce req-b7ed1c5c-cb82-4c04-b5ad-e5274ff9ee59 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:31.431184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5d6c6cac-0c81-49b6-a463-00ce808999ce req-b7ed1c5c-cb82-4c04-b5ad-e5274ff9ee59 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:31.431846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5d6c6cac-0c81-49b6-a463-00ce808999ce req-b7ed1c5c-cb82-4c04-b5ad-e5274ff9ee59 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:31.447821 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-5d6c6cac-0c81-49b6-a463-00ce808999ce req-b7ed1c5c-cb82-4c04-b5ad-e5274ff9ee59 service nova] Creating event network-changed:d0e29cfb-c141-4cd4-ab78-e1b32fb810ef for instance 583bc208-8f85-4abe-be0f-096127a8a5fb on hv-cinder-85752 Sep 15 00:51:31.453325 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-5d6c6cac-0c81-49b6-a463-00ce808999ce req-b7ed1c5c-cb82-4c04-b5ad-e5274ff9ee59 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043943 Sep 15 00:51:31.454154 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 430/835] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:51:31.883098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:31.884042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:31.891419 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:31.891945 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:31.893058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:31.893965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:31.894423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:31.894847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:32.074578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:32.085614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:32.087098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:32.088346 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-55fb446c-4e93-4598-bb15-209710228074 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.210204 Sep 15 00:51:32.098198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 406/836] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:31 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:33.124191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:33.124901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:33.132463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:33.133003 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:33.133391 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:33.134091 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:33.134578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:33.135009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:33.263664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:33.271687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:33.273121 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:33.274284 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-57bba299-21c0-46ce-80aa-71f5fd34839e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1738 microversion: 2.20 time: 0.154354 Sep 15 00:51:33.274845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 431/837] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:33 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:33.468833 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-f40e2ba5-3290-4a55-9a8b-2288c136a2f1 req-b13c1cfe-cf56-4577-9fbb-3997e28bd722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583bc208-8f85-4abe-be0f-096127a8a5fb", "tag": "d0e29cfb-c141-4cd4-ab78-e1b32fb810ef"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:33.479102 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f40e2ba5-3290-4a55-9a8b-2288c136a2f1 req-b13c1cfe-cf56-4577-9fbb-3997e28bd722 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:33.479611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f40e2ba5-3290-4a55-9a8b-2288c136a2f1 req-b13c1cfe-cf56-4577-9fbb-3997e28bd722 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:33.480039 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f40e2ba5-3290-4a55-9a8b-2288c136a2f1 req-b13c1cfe-cf56-4577-9fbb-3997e28bd722 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:33.492008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-f40e2ba5-3290-4a55-9a8b-2288c136a2f1 req-b13c1cfe-cf56-4577-9fbb-3997e28bd722 service nova] Creating event network-changed:d0e29cfb-c141-4cd4-ab78-e1b32fb810ef for instance 583bc208-8f85-4abe-be0f-096127a8a5fb on hv-cinder-85752 Sep 15 00:51:33.497024 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-f40e2ba5-3290-4a55-9a8b-2288c136a2f1 req-b13c1cfe-cf56-4577-9fbb-3997e28bd722 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031835 Sep 15 00:51:33.497604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 407/838] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:51:33.538206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3a6a0a51-142c-4295-8c28-623b8835222a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:33.544138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a6a0a51-142c-4295-8c28-623b8835222a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:33.544628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a6a0a51-142c-4295-8c28-623b8835222a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:33.545068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a6a0a51-142c-4295-8c28-623b8835222a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:33.567123 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3a6a0a51-142c-4295-8c28-623b8835222a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Going to try to stop instance {{(pid=127199) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 00:51:33.607022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3a6a0a51-142c-4295-8c28-623b8835222a tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/action" status: 202 len: 0 microversion: 2.1 time: 0.072563 Sep 15 00:51:33.607638 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 432/839] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:51:33 2022] POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:51:33.616994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:33.617728 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:33.623814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:33.624303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:33.625077 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:33.625487 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:33.625971 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:33.626638 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:33.770118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:33.777817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a71008b1-ed05-4dd4-88cb-cb1b8889267c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.165175 Sep 15 00:51:33.778375 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 408/840] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:33 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:34.300163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:34.300858 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:34.306851 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:34.307347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:34.307823 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:34.308527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:34.308991 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:34.309421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:34.599327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:34.607356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:34.608862 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:34.610032 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8cb50e98-d5e0-4033-a665-5771c6ff9cd8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1720 microversion: 2.20 time: 0.314687 Sep 15 00:51:34.610589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 433/841] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:34 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:34.801800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:34.802418 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:34.808798 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:34.809289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:34.809739 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:34.810444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:34.810904 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:34.811340 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:34.945137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:34.953017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b9e88d78-22a7-4305-a996-a36ceec93a92 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.155592 Sep 15 00:51:34.953592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 409/842] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:34 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:35.637117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:35.637735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:35.644775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:35.645273 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:35.645718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:35.646417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:35.646877 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:35.647343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:35.797589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:35.805532 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:35.806974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:35.808158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-06bc11e2-33c0-468d-8256-9497b3633df6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1720 microversion: 2.20 time: 0.175027 Sep 15 00:51:35.808718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 434/843] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:35 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:35.975688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:35.976303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:35.982823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:35.983258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:35.983735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:35.984434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:35.984894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:35.985325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:36.113018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:36.120670 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-37fe7870-1d4b-4d87-bee2-b52507eaae2c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.148903 Sep 15 00:51:36.121234 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 410/844] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:35 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:36.564168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f7f95e7d-92a1-4a21-968c-d08b3bc31b3d req-56fb6589-f676-4869-9066-b205f6d18d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "469fcc1e-0231-4642-b72f-c2bf7fd7eb07", "name": "network-vif-unplugged", "status": "completed", "tag": "86077b58-abc6-43a7-9b01-51a893794c4e"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:36.573699 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f7f95e7d-92a1-4a21-968c-d08b3bc31b3d req-56fb6589-f676-4869-9066-b205f6d18d38 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:36.574186 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f7f95e7d-92a1-4a21-968c-d08b3bc31b3d req-56fb6589-f676-4869-9066-b205f6d18d38 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:36.574653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f7f95e7d-92a1-4a21-968c-d08b3bc31b3d req-56fb6589-f676-4869-9066-b205f6d18d38 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:36.585607 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f7f95e7d-92a1-4a21-968c-d08b3bc31b3d req-56fb6589-f676-4869-9066-b205f6d18d38 service nova] Creating event network-vif-unplugged:86077b58-abc6-43a7-9b01-51a893794c4e for instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 on hv-cinder-85752 Sep 15 00:51:36.590424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f7f95e7d-92a1-4a21-968c-d08b3bc31b3d req-56fb6589-f676-4869-9066-b205f6d18d38 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029939 Sep 15 00:51:36.591030 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 435/845] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:51:36.834290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:36.834905 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:36.840918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:36.841406 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:36.841840 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:36.842537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:36.842993 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:36.843413 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:36.978545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:36.987260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:36.988741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:36.989902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-21c0ab2e-fa51-4548-a802-fed1dd2bf43f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1720 microversion: 2.20 time: 0.160003 Sep 15 00:51:36.990454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 411/846] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:36 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:37.146281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:37.147149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:37.149171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=56 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:37.154728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:37.155213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:37.155683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:37.156381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:37.156939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:37.157424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:37.288889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:37.296455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-173163fd-b2fc-4871-aeb3-7aa7fbd4f6a4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.155434 Sep 15 00:51:37.297016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 436/847] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:37 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:38.015512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:38.016160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:38.022510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:38.022988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:38.023423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:38.024152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:38.024608 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:38.025033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:38.150965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:38.159398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:38.160868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:38.162020 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a911f65d-983e-4e09-91c9-f36a2053c02c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1663 microversion: 2.20 time: 0.150628 Sep 15 00:51:38.162575 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 412/848] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:38 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:38.186987 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff2e2a19-7d56-42f5-be4d-f334bbc51f18"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:38.189347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:38.195720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:38.196202 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:38.196634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:38.197324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:38.197778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:38.198202 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:38.319542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:38.320162 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:38.326060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:38.326549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:38.326988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:38.327709 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:38.328166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:38.328597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:38.375190 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:38.474505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:38.479973 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ed25412f-2e6a-4572-81fb-27d45e380b90 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296900 Sep 15 00:51:38.480772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 437/849] 10.222.0.15 () {62 vars in 1364 bytes} [Thu Sep 15 00:51:38 2022] POST /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 00:51:38.482738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e13d2ef2-b9db-4b80-a1ec-3c72becb00fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.167196 Sep 15 00:51:38.483552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 413/850] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:38 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:51:38.603582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:38.604313 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:38.610593 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:38.611085 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:38.611615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:38.612316 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:38.612778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:38.613211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:38.746289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127199) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 00:51:38.815983 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [80da2e20-e118-44f7-9f29-bf0df07b4c01] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 00:51:39.505197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:39.506170 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:39.512617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:39.513097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:39.513531 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:39.514215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:39.514667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:39.515090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:39.683418 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:39.793701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:39.801272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0ef94a05-3f9a-4188-bd75-339eb8124028 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.300188 Sep 15 00:51:39.801822 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 414/851] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:39 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:51:39.823210 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [80da2e20-e118-44f7-9f29-bf0df07b4c01] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 50266. Sep 15 00:51:39.826312 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5b04d82c-9604-48a7-b762-603b796a8950 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/action" status: 202 len: 0 microversion: 2.20 time: 1.226702 Sep 15 00:51:39.826915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 438/852] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 15 00:51:38 2022] POST /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/action => generated 0 bytes in 1228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:51:39.835300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:39.835888 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:39.841624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:39.842112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:39.842543 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:39.843236 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:39.843789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:39.844212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:39.976959 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:39.985574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:39.987044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:39.988237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1ab22df6-e7fc-469c-b02a-5e9381cbb823 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1749 microversion: 2.20 time: 0.156790 Sep 15 00:51:39.988790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 415/853] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:39 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:40.824736 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:40.825479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:40.831371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:40.831890 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:40.832322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:40.833016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:40.833474 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:40.833898 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:40.963948 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:40.972237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-87b27eb7-d374-4da6-9953-a8f0a105cc2f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.151913 Sep 15 00:51:40.972820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 439/854] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:40 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:41.013515 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:41.014134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:41.020697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:41.021291 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:41.021603 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:41.022299 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:41.022753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:41.023203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:41.154684 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:41.163717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:41.165162 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:41.166329 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d931b4da-6205-46b9-9b8c-42ee56132097 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1751 microversion: 2.20 time: 0.156742 Sep 15 00:51:41.166874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 416/855] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:41 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:41.995613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:41.996214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:42.003736 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:42.004228 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:42.004668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:42.005366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:42.005827 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:42.006253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:42.134714 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:42.142378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bc4645b8-cd66-4899-b760-373ea4d4c304 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.150671 Sep 15 00:51:42.142937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 440/856] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:41 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:42.193248 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:42.193865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:42.200235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:42.200721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:42.201160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:42.201854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:42.202310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:42.202735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:42.331024 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:42.339562 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:42.341001 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:42.342168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7a06410d-81e0-414e-8206-d823843a3314 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.153494 Sep 15 00:51:42.342729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 417/857] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:42 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:43.168419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:43.169058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:43.176775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:43.177279 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:43.177725 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:43.178453 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:43.178945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:43.179382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:43.312428 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:43.320290 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e38dd89d-2bed-4a1d-b774-c7571227b8a9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.155955 Sep 15 00:51:43.320854 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 441/858] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:43 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:43.368302 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:43.369597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:43.377050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:43.377771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:43.378390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:43.379271 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:43.379931 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:43.380518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:43.572996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:43.583153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:43.584943 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:43.586136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d4c03b84-8fbc-4424-8ba5-8ad43180243f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.221737 Sep 15 00:51:43.586704 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 418/859] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:43 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:44.343788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:44.344404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:44.350937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:44.351382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:44.351874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:44.352857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:44.353270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:44.353737 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:44.487936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:44.495866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c258aec1-b284-4efc-b5d9-04c1560472e4 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.156008 Sep 15 00:51:44.496449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 442/860] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:44 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:44.612701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:44.614047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:44.620679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:44.621168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:44.621605 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:44.622315 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:44.622775 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:44.623205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:44.767852 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:44.777142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:44.778661 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:44.779879 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-72bbd76e-595e-4de8-ad1d-41531726cd52 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.171593 Sep 15 00:51:44.780439 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 419/861] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:44 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:45.519868 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:45.520484 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:45.527908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:45.528405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:45.528869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:45.529581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:45.530036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:45.530461 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:45.662370 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:45.671585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2ade7388-4b29-4746-a52b-086733eb6d57 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.156062 Sep 15 00:51:45.672407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 443/862] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:45 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:45.805801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:45.807274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:45.814249 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:45.815443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:45.816052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:45.816937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:45.817506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:45.818047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:45.952070 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:45.960727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:45.962231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:45.963394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ed2b76ce-1f2b-4e8b-902e-4605db010fe1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.161657 Sep 15 00:51:45.964022 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 420/863] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:45 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:46.703876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:46.705633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:46.712642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:46.713258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:46.713947 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:46.714822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:46.715445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:46.716052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:46.866358 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:46.874955 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-67048295-4991-4504-8bd8-48b271e71930 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.178960 Sep 15 00:51:46.875550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 444/864] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:46 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:46.988850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:46.989394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:46.996121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:46.996617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:46.997045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:46.997764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:46.998222 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:46.998652 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:47.133773 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:47.143525 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:47.144988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:47.146175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ef008006-be09-4b91-b710-c0cad1a93bd5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.161398 Sep 15 00:51:47.154276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 421/865] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:46 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:47.899032 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:47.899939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:47.908347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:47.908844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:47.909306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:47.910109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:47.910597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:47.911022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:48.044797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:48.053212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e161e1e3-63fa-4f15-b34c-9e5d27ca25fa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.158220 Sep 15 00:51:48.056724 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 445/866] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:47 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:48.171600 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:48.172977 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:48.179598 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:48.180077 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:48.180514 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:48.181225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:48.181681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:48.182115 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:48.321397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:48.330590 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:48.332583 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:48.334137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-63427305-c479-4794-920f-63cfc2216d15 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.166458 Sep 15 00:51:48.334891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 422/867] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:48 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:49.076753 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:49.077377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:49.084718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:49.085212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:49.085659 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:49.086377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:49.086841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:49.087276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:49.219344 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:49.227622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-95b36b78-0bbf-4c05-92ce-c18a46fe4d60 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.154717 Sep 15 00:51:49.228207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 446/868] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:49 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:49.360445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:49.361013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:49.368297 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:49.368901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:49.369544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:49.370269 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:49.370739 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:49.371174 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:49.510807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:49.520500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:49.521951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:49.523127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ad43405c-0e43-4e19-9c3b-ca4bd0ec70e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.166749 Sep 15 00:51:49.523715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 423/869] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:49 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:50.258149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:50.258815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:50.278584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:50.279103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:50.279514 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:50.280468 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:50.280967 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:50.281743 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:50.429332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:50.437750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0e83da71-a9bb-4bf0-bdf5-9d3cf48cc6fb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.190450 Sep 15 00:51:50.438536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 447/870] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:50 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:50.549646 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:50.550253 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:50.556732 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:50.557212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:50.557645 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:50.558335 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:50.558788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:50.559210 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:50.699138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:50.707956 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:50.709404 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:50.710584 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-434d3a8d-fa9e-4e96-aa39-b8966767c973 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.165414 Sep 15 00:51:50.711340 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 424/871] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:50 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:51.461865 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:51.462491 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:51.469234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:51.469739 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:51.470394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:51.471132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:51.471622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:51.472071 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:51.604096 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:51.612099 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9f52ad00-87c8-4456-b8c3-7bf74244bace tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.154084 Sep 15 00:51:51.612882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 448/872] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:51 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:51:51.737237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:51.737832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:51.745062 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:51.745553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:51.745999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:51.746711 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:51.747173 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:51.747633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:51.896328 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:51.905382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:51.906797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:51.908119 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a5b35385-1573-4953-a76e-a2565c1ead69 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.175426 Sep 15 00:51:51.908687 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 425/873] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:51 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:52.635968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:52.637411 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:52.644694 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:52.645542 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:52.646218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:52.647197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:52.647757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:52.648422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:52.791974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:52.800149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b1ded2af-b38a-461e-8ebd-85c648b813d7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.168129 Sep 15 00:51:52.800744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 449/874] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:52 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:52.934435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:52.935093 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:52.942284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:52.943015 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:52.943460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:52.944200 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:52.944669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:52.945105 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:53.084422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:53.094116 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:53.095653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:53.096968 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-99df7a83-78ff-4520-9796-516f09b1f3e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.166872 Sep 15 00:51:53.097520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 426/875] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:52 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:53.828739 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:53.829478 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:53.836270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:53.836843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:53.837389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:53.838181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:53.838718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:53.839225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:53.972103 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:53.980919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d5a49a03-fd7b-467e-a758-85dc0451377c tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.156013 Sep 15 00:51:53.981505 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 450/876] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:53 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:54.122318 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:54.123568 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:54.130353 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:54.130844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:54.131285 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:54.132027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:54.132486 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:54.132915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:54.268844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:54.277756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:54.279204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:54.280399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-60cba896-58c9-43eb-a619-30740898db4f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.162081 Sep 15 00:51:54.280959 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 427/877] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:54 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:55.005258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:55.005868 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:55.012302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:55.012788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:55.013225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:55.013918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:55.014376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:55.014800 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:55.144556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:55.152106 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-964b05fe-bb11-4e43-a9be-f3f0780e7aca tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.151482 Sep 15 00:51:55.152675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 451/878] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:54 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:55.305996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:55.306553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:55.312912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:55.313394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:55.313881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:55.314571 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:55.315021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:55.315464 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:55.443073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:55.451551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:55.453015 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:55.454168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-909c47d4-45ad-43b5-bf0f-c3ab02ea5468 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.152133 Sep 15 00:51:55.454720 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 428/879] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:55 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:51:56.175306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:56.175938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:56.182580 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:56.183063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:56.183521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:56.184216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:56.184692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:56.185101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:56.187619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:56.479645 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:56.480358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:56.487011 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:56.487576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:56.487951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:56.488645 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:56.489096 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:56.489519 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:56.515745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:56.523919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-386beadd-5db3-403a-8276-b6b0b4d390f6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.352427 Sep 15 00:51:56.524490 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 452/880] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:56 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:56.616423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:56.624914 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:56.627096 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:56.628277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-234ad582-7816-4e8a-8e72-00629e6da743 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.152520 Sep 15 00:51:56.628830 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 429/881] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:56 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:51:57.547720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:57.548847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:57.555164 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:57.555687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:57.556122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:57.556820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:57.557279 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:57.557757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:57.654179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:57.654823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:57.656666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=58 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:57.662312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:57.662813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:57.663260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:57.663994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:57.664455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:57.664904 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:57.684241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:57.697010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-adc32764-a31c-44ae-a4f0-1179fe017289 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1674 microversion: 2.1 time: 0.153238 Sep 15 00:51:57.697685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 453/882] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:57 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:57.795910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:57.804447 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:57.805834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:57.807000 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8a41e60b-b787-4a59-bfb8-270de02fdc05 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.156881 Sep 15 00:51:57.807581 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 430/883] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:57 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:51:58.720109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:58.720779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:58.727239 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:58.727760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:58.728203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:58.728899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:58.729358 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:58.729784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:58.859883 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:58.868213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b178560a-62d7-4197-b615-03fc58bb2480 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1651 microversion: 2.1 time: 0.152005 Sep 15 00:51:58.868791 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 454/884] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:58 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1651 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:51:58.890276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9bbac729-39ed-4e9d-b0d1-9ee0339cc28d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:51:58.896167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbac729-39ed-4e9d-b0d1-9ee0339cc28d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:58.896670 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbac729-39ed-4e9d-b0d1-9ee0339cc28d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:58.897111 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbac729-39ed-4e9d-b0d1-9ee0339cc28d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:58.919419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9bbac729-39ed-4e9d-b0d1-9ee0339cc28d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Going to try to start instance {{(pid=127199) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 00:51:58.937360 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:58.937985 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:58.943938 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:58.944603 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:58.944873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:58.945577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:58.946171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:58.946617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:58.950918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:58.961526 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9bbac729-39ed-4e9d-b0d1-9ee0339cc28d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/action" status: 202 len: 0 microversion: 2.1 time: 0.074806 Sep 15 00:51:58.962126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 455/885] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:51:58 2022] POST /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 00:51:58.970198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:51:58.971422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:51:58.977297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:58.977789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:58.978223 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:58.978921 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:51:58.979377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:51:58.979830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:51:59.081304 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:59.090020 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:59.091471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:59.092662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8ec615ce-212c-4800-a284-b25bd062c37e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.264203 Sep 15 00:51:59.093385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 431/886] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:51:58 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:51:59.114417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:51:59.122140 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-34ef9f22-44ce-439c-b24a-df039a980c2d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1660 microversion: 2.1 time: 0.155840 Sep 15 00:51:59.122694 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 456/887] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:51:58 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1660 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:00.118102 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:00.118715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:00.125136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:00.125618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:00.126306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:00.126998 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:00.127452 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:00.127906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:00.145615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:00.146233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:00.152492 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:00.153013 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:00.153487 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:00.154219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:00.154683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:00.155113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:00.261488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:00.272193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:00.273628 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:00.274808 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2a46a55f-ce97-41a4-85f2-e091e7b0c5f8 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.160590 Sep 15 00:52:00.275363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 432/888] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:00 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:00.285904 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:00.294426 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-462a9006-6531-44e8-a2a4-21494a4a6fc5 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1660 microversion: 2.1 time: 0.152869 Sep 15 00:52:00.295181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 457/889] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:00 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1660 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:01.300661 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:01.301279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:01.307669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:01.308150 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:01.308615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:01.309307 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:01.309761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:01.310183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:01.318051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:01.318669 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:01.324918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:01.325392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:01.325835 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:01.326535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:01.326995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:01.327437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:01.442111 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:01.450823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:01.452359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:01.453542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-12459f74-d553-499e-8999-4ebd6e6400de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.156938 Sep 15 00:52:01.454113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 433/890] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:01 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:01.454633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:01.463041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-28b85a13-5ce2-4550-9213-6fc1e5b02991 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1660 microversion: 2.1 time: 0.149289 Sep 15 00:52:01.463619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 458/891] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:01 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1660 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:02.479813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:02.480454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:02.485631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:02.486327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:02.486787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:02.487277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:02.487753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:02.488453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:02.488937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:02.489364 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:02.492678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:02.493177 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:02.493618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:02.494322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:02.494783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:02.495217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:02.622613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:02.625554 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:02.632100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:02.633712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:02.634051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-83304fb8-b89f-4560-9a45-c28573f4bfa2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1664 microversion: 2.1 time: 0.152164 Sep 15 00:52:02.634626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 459/892] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:02 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:02.634875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-33f5a8d1-b5d1-44d7-baf3-b398821f532c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.159097 Sep 15 00:52:02.635452 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 434/893] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:02 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:03.661024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:03.661641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:03.668049 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:03.668543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:03.668987 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:03.669720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:03.670188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:03.670619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:03.796205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:03.804699 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:03.806140 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:03.807308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-290c0a87-bfe1-4759-bd86-bef2c64303f3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.150741 Sep 15 00:52:03.807909 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 460/894] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:03 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:04.832539 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:04.833139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:04.839845 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:04.840360 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:04.840802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:04.841583 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:04.842044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:04.842505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:04.969862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:04.978846 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:04.980322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:04.981482 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2942af7f-f762-4c25-902a-5781f0823778 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.152918 Sep 15 00:52:04.982051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 435/895] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:04 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:06.008009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:06.008571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:06.015023 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:06.015556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:06.016004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:06.016705 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:06.017166 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:06.017598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:06.152497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:06.161088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:06.162527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:06.163717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7fec9852-3edb-43fe-8eb0-3127021f4c66 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.159669 Sep 15 00:52:06.164275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 461/896] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:06 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:07.190159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:07.190830 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:07.197318 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:07.197803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:07.198236 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:07.198933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:07.199384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:07.199836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:07.327180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:07.336384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:07.337820 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:07.339526 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ff6f9657-2453-42f4-bd06-e19d42a03a62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.153761 Sep 15 00:52:07.340094 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 436/897] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:07 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:08.365160 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:08.365798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:08.368256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:52:08.373442 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:08.373944 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:08.374376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:08.375081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:08.375577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:08.376263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:08.508590 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:08.516989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:08.518480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:08.519671 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3c57487f-357f-4e4a-bfc0-e2fb17860406 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.158886 Sep 15 00:52:08.520233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 462/898] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:08 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:08.734711 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-ad523835-249e-45b7-a21d-fe7fb306207e req-f47f684b-3a7d-4efe-9cf9-dd7d5d1393b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "469fcc1e-0231-4642-b72f-c2bf7fd7eb07", "name": "network-vif-plugged", "status": "completed", "tag": "86077b58-abc6-43a7-9b01-51a893794c4e"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:52:08.746488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-ad523835-249e-45b7-a21d-fe7fb306207e req-f47f684b-3a7d-4efe-9cf9-dd7d5d1393b6 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:08.747372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-ad523835-249e-45b7-a21d-fe7fb306207e req-f47f684b-3a7d-4efe-9cf9-dd7d5d1393b6 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:08.747968 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-ad523835-249e-45b7-a21d-fe7fb306207e req-f47f684b-3a7d-4efe-9cf9-dd7d5d1393b6 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:08.760582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-ad523835-249e-45b7-a21d-fe7fb306207e req-f47f684b-3a7d-4efe-9cf9-dd7d5d1393b6 service nova] Creating event network-vif-plugged:86077b58-abc6-43a7-9b01-51a893794c4e for instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 on hv-cinder-85752 Sep 15 00:52:08.765609 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-ad523835-249e-45b7-a21d-fe7fb306207e req-f47f684b-3a7d-4efe-9cf9-dd7d5d1393b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035100 Sep 15 00:52:08.766305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 437/899] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:52:09.544509 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:09.545130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:09.551759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:09.552202 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:09.552648 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:09.553349 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:09.553813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:09.554247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:09.682374 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:09.691519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:09.692955 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:09.694112 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-27770431-26c8-4f9c-bb2d-207fadde45cc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.153481 Sep 15 00:52:09.694666 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 463/900] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:09 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:52:10.722067 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:10.722802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:10.728906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:10.729386 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:10.729817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:10.730508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:10.730960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:10.731378 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:10.864759 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:10.873233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:10.874662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:10.876120 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2b3c3156-f70b-4881-bb85-0604db2721ea tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.159322 Sep 15 00:52:10.877169 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 438/901] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:10 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:11.902248 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:11.903047 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:11.909799 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:11.910276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:11.910715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:11.911416 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:11.912076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:11.912508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:12.044015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:12.053337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:12.054961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:12.056184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cdbfc03f-7329-4fa9-9ed2-93c8aedd10a9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1807 microversion: 2.20 time: 0.157916 Sep 15 00:52:12.056769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 464/902] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:11 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:13.083116 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:13.084577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:13.092228 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:13.092872 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:13.093358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:13.094144 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:13.094662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:13.095874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:13.225160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:13.233789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:13.235245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:13.236481 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5fa39c17-db6e-4754-b595-d0fbcc14c5ba tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1794 microversion: 2.20 time: 0.158467 Sep 15 00:52:13.237040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 439/903] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:52:13 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:52:26.036263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:52:26.038552 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:26.040785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=5 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:52:26.041445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:52:26.046891 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:26.047469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:26.047901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:26.048603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:26.049064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:26.049497 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:26.119169 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5db8ee27-26f2-45ac-95e5-ff43aa1da4d6 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "POST /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/action" status: 202 len: 0 microversion: 2.1 time: 0.086705 Sep 15 00:52:26.120004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 465/904] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:52:26 2022] POST /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:52:26.128719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:26.129382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:26.131976 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=19 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:52:26.132721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=48 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:52:26.138343 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:26.138835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:26.139268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:26.139988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:26.140446 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:26.140870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:26.282647 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:26.290913 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-83b0fd4c-320b-4d9d-a0e9-9aad11f18b94 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1751 microversion: 2.1 time: 0.166706 Sep 15 00:52:26.291502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 440/905] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:26 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:27.315461 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:27.316195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:27.322361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:27.322850 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:27.323286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:27.324018 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:27.324480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:27.324936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:27.468136 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:27.476980 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2682caab-c8ac-42c3-8d98-984c303e3ad2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.166816 Sep 15 00:52:27.477540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 466/906] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:27 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:28.501216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:28.503302 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:28.508629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:28.509117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:28.509558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:28.510260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:28.510719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:28.511146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:28.659336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:28.667584 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fb622931-1f37-4105-9ab3-e5cab1278296 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.170702 Sep 15 00:52:28.668175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 441/907] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:28 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:29.691015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:29.691682 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:29.698073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:29.698582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:29.699021 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:29.699807 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:29.700263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:29.700686 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:29.840058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:29.848341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-63fbe149-fba7-45f4-a5bd-b61532d9c909 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.161733 Sep 15 00:52:29.848916 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 467/908] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:29 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:30.871585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:30.872205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:30.879499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:30.879999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:30.880434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:30.881125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:30.881578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:30.882004 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:31.019712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:31.027932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d4f98b79-a9a2-4008-8df0-73ae71f0bb42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.160210 Sep 15 00:52:31.028510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 442/909] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:30 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:32.052608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:32.053152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:32.059697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:32.060185 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:32.060655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:32.061349 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:32.061806 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:32.062234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:32.201352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:32.210196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4f2c5204-bb97-40b7-98ac-be553bf31b69 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.162093 Sep 15 00:52:32.210762 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 468/910] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:32 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:33.233878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:33.234495 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:33.241441 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:33.241932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:33.242373 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:33.243078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:33.243569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:33.244002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:33.385713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:33.393838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8f4ac790-8d17-4c11-b709-f8e7b5fcdc23 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.163895 Sep 15 00:52:33.394412 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 443/911] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:33 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:34.416611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:34.417231 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:34.424151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:34.424641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:34.425118 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:34.425809 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:34.426263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:34.426685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:34.564002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:34.572311 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-89b164b1-5b80-48d1-8236-27f8b214447c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.159563 Sep 15 00:52:34.572876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 469/912] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:34 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:35.596377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:35.596994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:35.603466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:35.603983 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:35.604425 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:35.605124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:35.605582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:35.606042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:35.747319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:35.755709 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e0d093c4-130f-4850-84dc-a42b6029388c tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.163798 Sep 15 00:52:35.756268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 444/913] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:35 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:36.778439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:36.779051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:36.786431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:36.786924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:36.787364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:36.788094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:36.788554 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:36.788986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:36.933640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:36.941913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9a62c885-1310-4ea8-8865-e452ef37afa2 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.167295 Sep 15 00:52:36.942474 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 470/914] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:36 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:37.804224 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:37.804788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:37.811545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:37.812037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:37.812477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:37.813176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:37.813636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:37.814066 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:37.893765 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lazy-loading 'services' on Instance uuid 583bc208-8f85-4abe-be0f-096127a8a5fb {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:52:37.964693 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:37.965305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:37.965442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c5ec8be3-2675-4199-ac85-e885d684b014 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments/f935e746-a07b-4da0-a608-81bf93f213ee" status: 202 len: 0 microversion: 2.1 time: 0.165474 Sep 15 00:52:37.965929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 445/915] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:52:37 2022] DELETE /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments/f935e746-a07b-4da0-a608-81bf93f213ee => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:52:37.972910 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:37.973435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:37.973905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:37.974681 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:37.975151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:37.975616 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:37.976033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:37.978495 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:37.984760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:37.985307 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:37.985835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:37.986618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:37.987839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:37.988309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:38.020747 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-66352582-ff7f-4b68-94fb-1bd95bd73486 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050128 Sep 15 00:52:38.021553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 446/916] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:52:37 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:52:38.124789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:38.133367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b1a72009-6ab4-43f0-8b7a-888ba7c16a15 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.172501 Sep 15 00:52:38.133928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 471/917] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:37 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:39.033509 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:39.035677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:39.041992 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:39.042474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:39.042906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:39.043694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:39.044149 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:39.044642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:39.076052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b0516802-8378-4e13-aaf7-439074bac43f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Sep 15 00:52:39.076868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 447/918] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:52:39 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:52:39.157787 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:39.158805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:39.164870 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:39.165375 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:39.165826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:39.166546 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:39.167012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:39.167448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:39.312824 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:39.321014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8feabe50-56ba-400e-ad99-957e60f1bf83 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.167624 Sep 15 00:52:39.321574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 472/919] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:39 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:40.088012 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:40.090141 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:40.096544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:40.097029 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:40.097468 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:40.098177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:40.098662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:40.099088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:40.128438 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b70ac1e6-3289-4bc8-8af7-688ff8177667 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044489 Sep 15 00:52:40.128997 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 448/920] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:52:40 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 00:52:40.208010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:40.208522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:40.214790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:40.215276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:40.215744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:40.216441 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:40.216900 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:40.217323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:40.241596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:52:40.323582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-89081054-b1cd-402a-b9aa-9c6dc8c243cb tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 204 len: 0 microversion: 2.1 time: 0.119653 Sep 15 00:52:40.324235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 473/921] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:52:40 2022] DELETE /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:52:40.333058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:40.333700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:40.339696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:40.340127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:40.340570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:40.341271 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:40.341737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:40.342193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:40.343655 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:40.344353 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:40.350081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:40.350561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:40.350996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:40.351726 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:40.352180 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:40.352606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:40.478198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:40.486031 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8cbc76ca-61a7-48d9-809f-d589ddfd0945 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1687 microversion: 2.1 time: 0.157652 Sep 15 00:52:40.486811 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 449/922] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:40 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:40.496473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:40.505252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7333f67d-b74b-4808-aedc-e25e9c67f3de tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.165714 Sep 15 00:52:40.505825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 474/923] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:40 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:41.510277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:41.510893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:41.517355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:41.517841 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:41.518280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:41.518981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:41.519439 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:41.519893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:41.530874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:41.531509 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:41.538019 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:41.538509 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:41.538954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:41.539693 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:41.540159 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:41.540591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:41.649821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:41.657574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ad4283d6-ddda-4707-b7c7-2bf13b2b214f tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1687 microversion: 2.1 time: 0.151215 Sep 15 00:52:41.658140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 450/924] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:41 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:41.681058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:41.689410 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dc2868f1-757e-4bff-a839-144ddbb67a10 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.162378 Sep 15 00:52:41.690091 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 475/925] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:41 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:42.680019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:42.680668 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:42.687019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:42.687538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:42.687986 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:42.688686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:42.689150 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:42.689602 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:42.713929 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:42.714625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:42.721113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:42.721676 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:42.722171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:42.722942 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:42.723464 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:42.724037 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:42.817214 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:42.825436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-de7842f6-9bb0-4d03-a6dc-fa127c4dbd6c tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1687 microversion: 2.1 time: 0.149284 Sep 15 00:52:42.826138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 451/926] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:42 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:42.865318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:42.873597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b35c9d5a-9038-4ac5-b26e-0ecf3f3f13ca tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.164046 Sep 15 00:52:42.874162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 476/927] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:42 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:43.848998 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:43.849608 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:43.856635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:43.857118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:43.857555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:43.858245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:43.858697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:43.859150 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:43.897267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:43.897883 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:43.904546 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:43.904913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:43.905429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:43.906058 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:43.906544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:43.906981 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:43.991585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:43.999356 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-44534712-0d76-43b4-bc53-39e876536de2 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1687 microversion: 2.1 time: 0.154205 Sep 15 00:52:43.999966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 452/928] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:43 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:44.086259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:44.095041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ec0e1a5d-4896-4556-9953-d29cb0f76543 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1756 microversion: 2.1 time: 0.201752 Sep 15 00:52:44.095639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 477/929] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:43 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:45.022701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:45.023459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:45.030598 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:45.031301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:45.031791 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:45.032499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:45.033276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:45.033726 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:45.118211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:45.118796 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:45.122858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:45.125836 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:45.126318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:45.126927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:45.131797 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8378ab92-edb9-4de4-b3d3-e77ac209f696 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1621 microversion: 2.1 time: 0.113070 Sep 15 00:52:45.133002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:45.133133 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 453/930] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:45 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1621 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:45.133489 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:45.133929 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:45.587153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:45.593521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:52:45.601661 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f2b28baa-fa17-497f-a8fb-aecbf494ff42 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1759 microversion: 2.1 time: 0.487378 Sep 15 00:52:45.602317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 478/931] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:45 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1759 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:45.706161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-f204672d-1fa6-413f-b8fd-43f34ec8d726 req-5aaa5d88-d542-4325-b8d0-48889fdd55a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583bc208-8f85-4abe-be0f-096127a8a5fb", "name": "network-vif-deleted", "tag": "d0e29cfb-c141-4cd4-ab78-e1b32fb810ef"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:52:45.715281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f204672d-1fa6-413f-b8fd-43f34ec8d726 req-5aaa5d88-d542-4325-b8d0-48889fdd55a7 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:45.715799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f204672d-1fa6-413f-b8fd-43f34ec8d726 req-5aaa5d88-d542-4325-b8d0-48889fdd55a7 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:45.716235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f204672d-1fa6-413f-b8fd-43f34ec8d726 req-5aaa5d88-d542-4325-b8d0-48889fdd55a7 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:45.727271 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-f204672d-1fa6-413f-b8fd-43f34ec8d726 req-5aaa5d88-d542-4325-b8d0-48889fdd55a7 service nova] Creating event network-vif-deleted:d0e29cfb-c141-4cd4-ab78-e1b32fb810ef for instance 583bc208-8f85-4abe-be0f-096127a8a5fb on hv-cinder-85752 Sep 15 00:52:45.732893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-f204672d-1fa6-413f-b8fd-43f34ec8d726 req-5aaa5d88-d542-4325-b8d0-48889fdd55a7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030372 Sep 15 00:52:45.733674 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 454/932] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:52:46.159221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:46.160415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:46.176528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:46.177378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:46.178205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:46.179121 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:46.179803 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:46.180426 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:46.219187 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:46.219721 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:46.220160 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:46.220605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lazy-loading 'fault' on Instance uuid 583bc208-8f85-4abe-be0f-096127a8a5fb {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:52:46.264105 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:46.275054 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-add83a4a-0895-4452-8c7f-0caa06b911ca tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 200 len: 1335 microversion: 2.1 time: 0.122127 Sep 15 00:52:46.283825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 479/933] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:46 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 1335 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:47.299540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:47.300233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 583bc208-8f85-4abe-be0f-096127a8a5fb] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:47.306793 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:47.307290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:47.307768 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:47.308488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:47.308945 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:47.309373 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:47.323729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] HTTP exception thrown: Instance 583bc208-8f85-4abe-be0f-096127a8a5fb could not be found. Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Request method failure captured: Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb HTTP/1.1 Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInV5eOfxwz_L73XdSLZWs9muQNY38kG-uSkSdNdD8kYJGR4XiNtFxq0Biq3TCHGtX13rOTtMlS0D_4QILbpyxnJYCKqG4JBVLvzkCUnjXpiqmwovyYFBWquCXGGjip-3VBu43caF28c5uwRoM3euCFhr7Swgrcz6Ragt_7hg-yuoFig Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:52:47.325523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7090f91f78534107ba4b5ccd7f80e145", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7090f91f78534107ba4b5ccd7f80e145"}]}] Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 4e0e6a33679f4cac96704f71dcfa5c01 Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 583bc208-8f85-4abe-be0f-096127a8a5fb could not be found. Sep 15 00:52:47.327168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '583bc208-8f85-4abe-be0f-096127a8a5fb'} Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583bc208-8f85-4abe-be0f-096127a8a5fb could not be found. Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:52:47.333185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583bc208-8f85-4abe-be0f-096127a8a5fb could not be found. Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583bc208-8f85-4abe-be0f-096127a8a5fb could not be found. Sep 15 00:52:47.334786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:47.336153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Returning 404 to user: Instance 583bc208-8f85-4abe-be0f-096127a8a5fb could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:52:47.336153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f7894cea-3d20-4e2f-8519-00e076f4f924 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb" status: 404 len: 111 microversion: 2.1 time: 0.032168 Sep 15 00:52:47.336153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 455/934] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:47 2022] GET /compute/v2.1/servers/583bc208-8f85-4abe-be0f-096127a8a5fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:52:47.337326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4a843145-0274-4a06-a052-1800e8a32e57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '.version_select at 0x7f2f1d0b43a0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:47.342446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4a843145-0274-4a06-a052-1800e8a32e57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [67b32589-c1d3-4861-8693-7a678ecdbba6] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 00:52:48.349255 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO oslo.messaging._drivers.impl_rabbit [None req-4a843145-0274-4a06-a052-1800e8a32e57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [67b32589-c1d3-4861-8693-7a678ecdbba6] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 50598. Sep 15 00:52:48.368240 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4a843145-0274-4a06-a052-1800e8a32e57 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947567249" status: 202 len: 0 microversion: 2.1 time: 1.034796 Sep 15 00:52:48.368824 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 480/935] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 00:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947567249 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:52:51.194897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:51.195396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:51.202460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:51.202936 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:51.203370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:51.204158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:51.204615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:51.205041 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:51.229866 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:52:51.243414 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:52:51.305959 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-71a479e3-34d1-436f-9642-3fabe3f929da tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 204 len: 0 microversion: 2.1 time: 0.114140 Sep 15 00:52:51.306610 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 456/936] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:52:51 2022] DELETE /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:52:51.316038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:51.316741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:51.324171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:51.325326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:51.325770 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:51.326468 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:51.326927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:51.327352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:51.458471 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:51.466332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a0716a00-59f5-4325-8001-1e2e48346632 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1507 microversion: 2.1 time: 0.154708 Sep 15 00:52:51.466901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 481/937] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:51 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:52.490142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:52.490848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:52.497655 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:52.498145 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:52.498588 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:52.499299 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:52.499792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:52.500483 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:52.650560 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:52.665106 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fcee30ca-d2cf-4362-8dec-4538fdca9d11 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 200 len: 1507 microversion: 2.1 time: 0.179125 Sep 15 00:52:52.666044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 457/938] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:52 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:52:52.732475 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-5c77c3a9-e96e-4ace-a126-ef26184f5a5f req-5a1c3751-9a87-4c9f-b10b-257b65d097ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3368c45f-e52e-42fd-8f8c-43e3aeb5aeef", "name": "network-vif-deleted", "tag": "a181a6dc-2e9a-4e22-a218-adf5eb7e3779"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:52:52.743765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5c77c3a9-e96e-4ace-a126-ef26184f5a5f req-5a1c3751-9a87-4c9f-b10b-257b65d097ef service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:52.744651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5c77c3a9-e96e-4ace-a126-ef26184f5a5f req-5a1c3751-9a87-4c9f-b10b-257b65d097ef service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:52.745469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-5c77c3a9-e96e-4ace-a126-ef26184f5a5f req-5a1c3751-9a87-4c9f-b10b-257b65d097ef service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:52.759139 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-5c77c3a9-e96e-4ace-a126-ef26184f5a5f req-5a1c3751-9a87-4c9f-b10b-257b65d097ef service nova] Creating event network-vif-deleted:a181a6dc-2e9a-4e22-a218-adf5eb7e3779 for instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef on hv-cinder-85752 Sep 15 00:52:52.765245 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-5c77c3a9-e96e-4ace-a126-ef26184f5a5f req-5a1c3751-9a87-4c9f-b10b-257b65d097ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036846 Sep 15 00:52:52.766125 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 482/939] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:52:53.693850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:53.694463 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:53.701148 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:53.701635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:53.702073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:53.702766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:53.703219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:53.703680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:53.717339 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] HTTP exception thrown: Instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef could not be found. Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Request method failure captured: Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef HTTP/1.1 Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInV5eOfxwz_L73XdSLZWs9muQNY38kG-uSkSdNdD8kYJGR4XiNtFxq0Biq3TCHGtX13rOTtMlS0D_4QILbpyxnJYCKqG4JBVLvzkCUnjXpiqmwovyYFBWquCXGGjip-3VBu43caF28c5uwRoM3euCFhr7Swgrcz6Ragt_7hg-yuoFig Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:52:53.718926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7090f91f78534107ba4b5ccd7f80e145", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7090f91f78534107ba4b5ccd7f80e145"}]}] Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 4e0e6a33679f4cac96704f71dcfa5c01 Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef could not be found. Sep 15 00:52:53.720592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '3368c45f-e52e-42fd-8f8c-43e3aeb5aeef'} Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef could not be found. Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:52:53.723873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef could not be found. Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef could not be found. Sep 15 00:52:53.725359 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:52:53.726670 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Returning 404 to user: Instance 3368c45f-e52e-42fd-8f8c-43e3aeb5aeef could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:52:53.726670 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2da0d07e-605f-4faf-8fb0-9305d7387009 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef" status: 404 len: 111 microversion: 2.1 time: 0.030467 Sep 15 00:52:53.726670 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 458/940] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:53 2022] GET /compute/v2.1/servers/3368c45f-e52e-42fd-8f8c-43e3aeb5aeef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:52:53.729380 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:53.729969 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:53.736061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:53.736613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:53.736975 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:53.737697 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:53.738158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:53.738588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:53.763797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:52:53.835793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-28b73417-388b-4c27-8dee-f6cddb13cf29 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 204 len: 0 microversion: 2.1 time: 0.110135 Sep 15 00:52:53.836820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 483/941] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:52:53 2022] DELETE /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:52:53.845282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:53.845898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:53.851879 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:53.852363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:53.852805 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:53.853532 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:53.853991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:53.854418 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:53.984994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:53.992574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1fe92330-b14c-4fb9-a0d6-e49b360f0ca1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.151151 Sep 15 00:52:53.993138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 459/942] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:53 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:55.015945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:55.016825 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:55.023138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:55.023665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:55.024109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:55.024812 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:55.025272 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:55.025702 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:55.214313 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e6a33679f4cac96704f71dcfa5c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7090f91f78534107ba4b5ccd7f80e145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:52:55.222593 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e2c8f95f-0e83-4eec-abc0-0a42059d7eaa tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 200 len: 1522 microversion: 2.1 time: 0.210947 Sep 15 00:52:55.223253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 484/943] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:55 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:52:55.419756 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-46afeff7-4c14-4890-8334-921190441fc8 req-b6d4d9f3-f1ba-4cb5-b131-16f9f6d1126d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40368c8-a515-46b7-add6-5db877d59406", "name": "network-vif-deleted", "tag": "3231acc1-76a4-4c22-96c0-9edb4cf1f79e"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:52:55.430660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-46afeff7-4c14-4890-8334-921190441fc8 req-b6d4d9f3-f1ba-4cb5-b131-16f9f6d1126d service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:55.431143 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-46afeff7-4c14-4890-8334-921190441fc8 req-b6d4d9f3-f1ba-4cb5-b131-16f9f6d1126d service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:55.431604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-46afeff7-4c14-4890-8334-921190441fc8 req-b6d4d9f3-f1ba-4cb5-b131-16f9f6d1126d service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:55.442382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-46afeff7-4c14-4890-8334-921190441fc8 req-b6d4d9f3-f1ba-4cb5-b131-16f9f6d1126d service nova] Creating event network-vif-deleted:3231acc1-76a4-4c22-96c0-9edb4cf1f79e for instance b40368c8-a515-46b7-add6-5db877d59406 on hv-cinder-85752 Sep 15 00:52:55.447202 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-46afeff7-4c14-4890-8334-921190441fc8 req-b6d4d9f3-f1ba-4cb5-b131-16f9f6d1126d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032198 Sep 15 00:52:55.447784 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 460/944] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:52:56.245340 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:52:56.245954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] [instance: b40368c8-a515-46b7-add6-5db877d59406] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:52:56.249083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:52:56.255183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:56.255706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:56.256148 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:56.256842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:52:56.257296 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:52:56.257722 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:52:56.272157 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] HTTP exception thrown: Instance b40368c8-a515-46b7-add6-5db877d59406 could not be found. Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Request method failure captured: Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 HTTP/1.1 Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV5eOfxwz_L73XdSLZWs9muQNY38kG-uSkSdNdD8kYJGR4XiNtFxq0Biq3TCHGtX13rOTtMlS0D_4QILbpyxnJYCKqG4JBVLvzkCUnjXpiqmwovyYFBWquCXGGjip-3VBu43caF28c5uwRoM3euCFhr7Swgrcz6Ragt_7hg-yuoFig Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:52:56.273756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7090f91f78534107ba4b5ccd7f80e145", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7090f91f78534107ba4b5ccd7f80e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7090f91f78534107ba4b5ccd7f80e145"}]}] Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 7090f91f78534107ba4b5ccd7f80e145 Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-482363131 Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 4e0e6a33679f4cac96704f71dcfa5c01 Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-ServerRescueNegativeTestJSON-482363131-project Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance b40368c8-a515-46b7-add6-5db877d59406 could not be found. Sep 15 00:52:56.275217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'b40368c8-a515-46b7-add6-5db877d59406'} Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40368c8-a515-46b7-add6-5db877d59406 could not be found. Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:52:56.278612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40368c8-a515-46b7-add6-5db877d59406 could not be found. Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40368c8-a515-46b7-add6-5db877d59406 could not be found. Sep 15 00:52:56.280042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:52:56.281926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] Returning 404 to user: Instance b40368c8-a515-46b7-add6-5db877d59406 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:52:56.281926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1d3016da-9a9c-4f89-9831-01273b07e3e1 tempest-ServerRescueNegativeTestJSON-482363131 tempest-ServerRescueNegativeTestJSON-482363131-project] 10.222.0.15 "GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406" status: 404 len: 111 microversion: 2.1 time: 0.033674 Sep 15 00:52:56.281926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 485/945] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:52:56 2022] GET /compute/v2.1/servers/b40368c8-a515-46b7-add6-5db877d59406 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:53:01.786052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:01.788613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:01.790578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:01.795712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:01.796293 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:01.796741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:01.797678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:01.798322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:01.798754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:01.836262 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ff9d7a1d-2cb7-49fd-9e80-43b53fa5d3b2 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055266 Sep 15 00:53:01.836940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 461/946] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:53:01 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 00:53:01.908242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:01.909662 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:01.920396 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:01.921569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:01.923821 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:01.924845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:01.925779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:01.926239 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:01.960533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:53:02.046879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-500d66a6-ee26-4947-affb-234eee31da3f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 204 len: 0 microversion: 2.1 time: 0.142553 Sep 15 00:53:02.050782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 486/947] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:53:01 2022] DELETE /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:53:02.056025 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:02.056640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:02.062525 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:02.063010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:02.063444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:02.064191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:02.064827 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:02.065279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:02.258750 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:02.267724 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-efcf4b1d-d7fa-4012-98d8-a338259a7f13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1670 microversion: 2.1 time: 0.215599 Sep 15 00:53:02.268224 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 462/948] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:02 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1670 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:03.292089 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:03.293410 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:03.300313 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:03.301110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:03.301552 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:03.302275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:03.302734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:03.303165 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:03.505448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:03.517216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-83d0904b-bc3b-4a78-92e2-21da9ebf3613 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1670 microversion: 2.1 time: 0.229343 Sep 15 00:53:03.517815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 487/949] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:03 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:04.542459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:04.543829 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:04.551142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:04.551991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:04.552642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:04.553561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:04.554229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:04.554842 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:04.643633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:04.671374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-aaeba953-7ee9-43e6-8e5a-252e8a807fcd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1602 microversion: 2.1 time: 0.132396 Sep 15 00:53:04.672111 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 463/950] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:04 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1602 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:04.764314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-8da644d2-c6aa-461f-a3b2-8f8c92a8d2b7 req-b4cfa265-34cc-407f-88a6-499e8a0a1169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d301ea-7505-4d72-8061-827894477da0", "name": "network-vif-deleted", "tag": "45e2672c-5f66-4187-b159-c6d3bb80d12b"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:04.780649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8da644d2-c6aa-461f-a3b2-8f8c92a8d2b7 req-b4cfa265-34cc-407f-88a6-499e8a0a1169 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:04.786132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8da644d2-c6aa-461f-a3b2-8f8c92a8d2b7 req-b4cfa265-34cc-407f-88a6-499e8a0a1169 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:04.792075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8da644d2-c6aa-461f-a3b2-8f8c92a8d2b7 req-b4cfa265-34cc-407f-88a6-499e8a0a1169 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:04.818857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-8da644d2-c6aa-461f-a3b2-8f8c92a8d2b7 req-b4cfa265-34cc-407f-88a6-499e8a0a1169 service nova] Creating event network-vif-deleted:45e2672c-5f66-4187-b159-c6d3bb80d12b for instance c1d301ea-7505-4d72-8061-827894477da0 on hv-cinder-85752 Sep 15 00:53:04.825283 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-8da644d2-c6aa-461f-a3b2-8f8c92a8d2b7 req-b4cfa265-34cc-407f-88a6-499e8a0a1169 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066258 Sep 15 00:53:04.829888 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 488/951] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:04.898899 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:04.900168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:04.913755 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:04.914803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:04.916368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:04.920264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:04.921002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:04.921451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:04.967317 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lazy-loading 'flavor' on Instance uuid e58c94a4-c708-4b2f-b8b1-fa336f60aa4b {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:53:05.187552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e763c57c-4d84-450f-963d-a5f9e16e0e87 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "POST /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b/action" status: 202 len: 0 microversion: 2.1 time: 0.293195 Sep 15 00:53:05.188703 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 464/952] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:53:04 2022] POST /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:53:05.197798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:05.198632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:05.207389 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:05.208592 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:05.209287 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:05.210428 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:05.211074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:05.211783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:05.393812 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:05.405813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ec6a3181-0827-4336-94e4-44a9c2e7ec0d tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.211670 Sep 15 00:53:05.416443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 489/953] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:05 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:05.682489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-32a54ade-bf9a-44bd-92af-b9e8c8c8c778 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: .version_select at 0x7f2f1ce99e50>, body: {"keypair": {"name": "tempest-keypair-553343496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkrXjSb4c2M3yiZEfeAd9Fy6jL4VYvYhqY5jH0WVigmuqbxnyAkOz6rgQ7fxWlV4g+V+FDPV3r7wT5hkU75z1zqDZM5rtourizmPjOmFbR+vzgLOtDWYjtpa+TUgnMapQ=="}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:05.698477 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:05.699742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:05.706722 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-32a54ade-bf9a-44bd-92af-b9e8c8c8c778 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:53:05.708726 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:05.709476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:05.711419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:05.712812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-32a54ade-bf9a-44bd-92af-b9e8c8c8c778 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for user 778fc9ee164e46a9b874dd0e20d38392 and project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:53:05.713523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:05.714568 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:05.715910 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:05.762586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:05.763343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:05.766533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:05.768194 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-32a54ade-bf9a-44bd-92af-b9e8c8c8c778 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.297337 Sep 15 00:53:05.769416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 465/954] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:53:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:05.771666 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lazy-loading 'fault' on Instance uuid c1d301ea-7505-4d72-8061-827894477da0 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:53:05.821391 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:05.829963 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-efc1e732-e99b-4581-a071-83b9c9aced58 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 200 len: 1325 microversion: 2.1 time: 0.139564 Sep 15 00:53:05.830622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 490/955] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:05 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 1325 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:06.430762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:06.431815 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:06.439921 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:06.441405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:06.442031 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:06.443035 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:06.443723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:06.444325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:06.597299 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:06.605521 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-64b960ee-1c00-40c3-b809-b127e531b25a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.178704 Sep 15 00:53:06.606189 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 466/956] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:06 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:06.853531 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:06.854145 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:06.861213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:06.861718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:06.862135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:06.862837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:06.863287 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:06.863734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:06.879600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] HTTP exception thrown: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Request method failure captured: Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 HTTP/1.1 Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV1YAp3RkRvuhAXqdAjRzTr155f6tjrLS0v45LN6_masbvjAaqieSsYqzT-IX1F94CLXuvyy56sejqhT6qIPAFc86cIyBj2L9v_r9nbCkkvrfgTYYRp6pGU_9Tm3rIjdyOEZazZSgN_gx2AfWVISwr3PjAdDu2-aWVWfXBzo4D_D6U Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:53:06.881256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6a9d9cf3606845ec964dd8320126293e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6a9d9cf3606845ec964dd8320126293e"}]}] Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: c5307118357e44ffbff5074ae4a94c9d Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:53:06.882860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'c1d301ea-7505-4d72-8061-827894477da0'} Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:53:06.883777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:53:06.885373 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:06.886665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Returning 404 to user: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:53:06.886665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0a966790-5716-40c5-bee6-035cb5237135 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 404 len: 111 microversion: 2.1 time: 0.033070 Sep 15 00:53:06.886665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 491/957] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:06 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:53:06.891554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ea333009-0881-4d0e-9ac4-889e61d3aa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '.version_select at 0x7f2f1d07f310>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:06.913344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ea333009-0881-4d0e-9ac4-889e61d3aa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-784784382" status: 202 len: 0 microversion: 2.1 time: 0.025530 Sep 15 00:53:06.914045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 467/958] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 00:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-784784382 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:53:07.321997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1149126453", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48f46f03-9920-4d15-b1d4-ea751486aaae"}], "security_groups": [{"name": "tempest-securitygroup--1821090443"}], "key_name": "tempest-keypair-553343496", "user_data": "}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:07.433151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] validate_networks() for [('48f46f03-9920-4d15-b1d4-ea751486aaae', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:53:07.632630 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:07.633500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:07.644529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:07.645463 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:07.646265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:07.648318 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:07.649192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:07.649858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:07.874580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:07.882814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d355f7b1-bc95-4836-bd65-548f59cdd87b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.257109 Sep 15 00:53:07.883388 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 468/959] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:07 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:07.888119 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b07dff6d-da21-470e-839c-4bd81508d7fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'create', calling method: .version_select at 0x7f2f1d072f70>, body: {"keypair": {"name": "tempest-keypair-1362082669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfkSwHy7nIpyaIS1bBliCR45dvbFzSi0mQRcZsn7l7T56cxlfefewuyh7Gh+SijmSwvpoOmETwq54DzINUSbfJ9h+6rljJomXnXmsX6yN43F3XTC+KtE3KxQXeKZa973Q=="}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:07.903457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-b07dff6d-da21-470e-839c-4bd81508d7fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Getting quotas for project 6a9d9cf3606845ec964dd8320126293e. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:53:07.907270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-b07dff6d-da21-470e-839c-4bd81508d7fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Getting quotas for user c5307118357e44ffbff5074ae4a94c9d and project 6a9d9cf3606845ec964dd8320126293e. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:53:07.933994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:53:07.935184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:53:07.935843 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b07dff6d-da21-470e-839c-4bd81508d7fc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051067 Sep 15 00:53:07.936077 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:53:07.936849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:53:07.937265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 469/960] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:53:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:07.937643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:53:07.946985 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:07.947879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:07.949430 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:07.957944 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:07.965414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:07.966151 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:08.007561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:53:08.017332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for user 778fc9ee164e46a9b874dd0e20d38392 and project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:53:08.033264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:53:08.036398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:53:08.097708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d4fbabe1-4899-4dfd-b574-492f2825f604 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779873 Sep 15 00:53:08.098360 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 492/961] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:53:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:53:08.109814 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-09b73d96-4bad-4a8f-a3e0-f00a1d91ac05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:08.111058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-09b73d96-4bad-4a8f-a3e0-f00a1d91ac05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:08.196664 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-09b73d96-4bad-4a8f-a3e0-f00a1d91ac05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:08.206089 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-09b73d96-4bad-4a8f-a3e0-f00a1d91ac05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1241 microversion: 2.1 time: 0.100311 Sep 15 00:53:08.207037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 470/962] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:08 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:09.067811 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:09.068606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:09.076610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:09.077361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:09.078036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:09.078970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:09.079820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:09.080652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:09.228040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:09.229386 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:09.236776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:09.237518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:09.238133 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:09.238998 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:09.239648 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:09.240229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:09.316681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:09.331680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-08b3cdba-1cca-48f6-b7ee-2e906a8201e0 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1293 microversion: 2.1 time: 0.106250 Sep 15 00:53:09.332973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 471/963] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:09 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:09.357382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:09.366564 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-37e7d2a6-1e97-41ab-96db-673027fecd8b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.461688 Sep 15 00:53:09.367764 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 493/964] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:08 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:09.700426 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-959444643", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c24ea2a-0e34-4fdb-be58-bbcdcac71ac0"}], "security_groups": [{"name": "tempest-securitygroup--727880410"}], "key_name": "tempest-keypair-1362082669", "user_data": "}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:09.728198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 00:53:09.729727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Thu Sep 15 00:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Sep 15 00:53:09.838192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] validate_networks() for [('5c24ea2a-0e34-4fdb-be58-bbcdcac71ac0', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:53:10.288810 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:53:10.289423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:53:10.289697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:53:10.290136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:53:10.290551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:53:10.302477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:10.303131 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:10.303709 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:10.304733 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:10.305298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:10.305988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:10.324852 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Getting quotas for project 6a9d9cf3606845ec964dd8320126293e. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:53:10.329794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Getting quotas for user c5307118357e44ffbff5074ae4a94c9d and project 6a9d9cf3606845ec964dd8320126293e. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:53:10.343003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:53:10.346763 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:53:10.355765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:10.356576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:10.364130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:10.364800 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:10.365496 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:10.366566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:10.367338 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:10.369213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:10.406860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c8243b89-c6dc-443a-9bd0-742bfba47faa tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.711523 Sep 15 00:53:10.407647 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 472/965] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:53:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 00:53:10.412671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:10.413571 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:10.421857 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:10.422509 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:10.423013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:10.423853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:10.424410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:10.424915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:10.465922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:10.479624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-34172496-c199-4ef1-b2a0-5d3374cff1d3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1299 microversion: 2.1 time: 0.127622 Sep 15 00:53:10.484901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 494/966] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:10 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:10.499432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d522184-3457-4741-a324-4bb5eada3fa0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:10.500603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d522184-3457-4741-a324-4bb5eada3fa0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:10.574198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7d522184-3457-4741-a324-4bb5eada3fa0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:10.585624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7d522184-3457-4741-a324-4bb5eada3fa0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1237 microversion: 2.1 time: 0.099820 Sep 15 00:53:10.587928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 495/967] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:10 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:10.590873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:10.600275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5ea5e2df-5228-4598-abe0-4ac8dae18450 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.190974 Sep 15 00:53:10.603518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 473/968] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:10 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:11.396826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-bd9b5e0a-6450-44e6-be4d-d06f4a433179 req-fae02fc2-cfb8-450c-b1f9-00c8a11be466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e47eda5-dffe-41dd-a09d-0870d19dd898", "tag": "4cd61e51-9091-42e2-b4f8-f67dbf137235"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:11.407294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd9b5e0a-6450-44e6-be4d-d06f4a433179 req-fae02fc2-cfb8-450c-b1f9-00c8a11be466 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:11.407830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd9b5e0a-6450-44e6-be4d-d06f4a433179 req-fae02fc2-cfb8-450c-b1f9-00c8a11be466 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:11.408260 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd9b5e0a-6450-44e6-be4d-d06f4a433179 req-fae02fc2-cfb8-450c-b1f9-00c8a11be466 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:11.419816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-bd9b5e0a-6450-44e6-be4d-d06f4a433179 req-fae02fc2-cfb8-450c-b1f9-00c8a11be466 service nova] Creating event network-changed:4cd61e51-9091-42e2-b4f8-f67dbf137235 for instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 on hv-cinder-85752 Sep 15 00:53:11.425098 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-bd9b5e0a-6450-44e6-be4d-d06f4a433179 req-fae02fc2-cfb8-450c-b1f9-00c8a11be466 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032054 Sep 15 00:53:11.425692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 496/969] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:11.504755 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:11.505376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:11.512485 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:11.512974 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:11.513538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:11.514104 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:11.514645 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:11.515057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:11.610887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:11.611733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:11.618113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:11.618693 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:11.619371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:11.620992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:11.621491 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:11.621989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:11.641450 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:11.647746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:11.657023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0552c5fc-6a41-40c4-8ebf-baa1e8efe19f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.156152 Sep 15 00:53:11.657822 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 474/970] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:11 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:11.662692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:11.663497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:11.670489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:11.672298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:11.672908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:11.673801 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:11.674538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:11.675156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:11.709780 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:11.724972 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f80cb988-52c6-41c1-a7f1-70e35bf59ac8 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1289 microversion: 2.1 time: 0.118351 Sep 15 00:53:11.725566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 497/971] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:11 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1289 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:11.819999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:11.828122 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5ce2ee86-8393-4bb2-85e5-0afdad4c4e53 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.169005 Sep 15 00:53:11.828684 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 475/972] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:11 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:12.680853 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:12.681630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:12.688233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:12.688794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:12.689340 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:12.690107 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:12.690624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:12.691113 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:12.748526 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:12.749266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:12.756075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:12.756578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:12.757021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:12.757770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:12.758234 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:12.758667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:12.763327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:12.831677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:12.839928 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-399f3f1f-c988-471b-89f1-477e694b893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1295 microversion: 2.1 time: 0.095291 Sep 15 00:53:12.840519 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 476/973] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:12 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:12.852828 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:12.853757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:12.860422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:12.860937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:12.861365 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:12.862057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:12.862514 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:12.862935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:12.968033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:12.976463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9985ae16-dfae-458c-b087-8b5997478ac2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.299412 Sep 15 00:53:12.992204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 498/974] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:12 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:12.999451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:13.007451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d1dede2c-7c67-4a8a-b2b4-036177f78db9 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.160249 Sep 15 00:53:13.008050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 477/975] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:12 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:13.862896 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:13.863526 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:13.869601 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:13.870083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:13.871022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:13.871753 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:13.872209 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:13.872634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:13.999510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:14.000497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:14.003198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:14.007394 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:14.007977 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:14.008813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:14.009580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:14.010105 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:14.010594 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:14.011412 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0451362c-d991-4cd6-b485-09b1fbb629fd tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.151867 Sep 15 00:53:14.012039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 499/976] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:13 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:14.032268 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:14.032881 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:14.038800 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:14.039284 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:14.039777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:14.040471 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:14.040925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:14.041346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:14.143674 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:14.153286 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1f4b73a5-918d-40c0-8c60-d93426decfe7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.157612 Sep 15 00:53:14.153868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 478/977] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:13 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:14.178772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:14.186574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-252c470f-5e79-42bd-aeb6-07b8f6269fc1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.158112 Sep 15 00:53:14.187137 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 500/978] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:14 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:15.034188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:15.034724 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:15.041223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:15.041706 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:15.042773 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:15.043467 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:15.043951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:15.044377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:15.174550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:15.176368 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:15.177689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:15.183471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b8e4c6c5-69aa-412c-9c37-c634526420cc tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.152646 Sep 15 00:53:15.195974 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 479/979] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:15 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:15.196263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:15.196263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:15.196263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:15.196263 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:15.196631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:15.196631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:15.209779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:15.210400 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:15.216203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:15.216690 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:15.217128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:15.217829 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:15.218286 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:15.218715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:15.319580 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:15.327390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8c97561c-1fc1-4c88-b169-43d8cb4b9fd9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.154965 Sep 15 00:53:15.328084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 501/980] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:15 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:15.347313 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:15.355759 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-aa6a8c38-ef63-48e0-864c-83e6258b1629 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.149723 Sep 15 00:53:15.356331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 480/981] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:15 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:16.206055 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:16.206573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:16.213215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:16.213710 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:16.214812 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:16.215553 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:16.216021 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:16.216452 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:16.350499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:16.351166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:16.358201 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:16.358782 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:16.359220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:16.360119 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:16.360629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:16.360997 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:16.497323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:16.505232 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b0a7706b-a0cd-4e8e-9d7c-557d741c01e8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.158873 Sep 15 00:53:16.506647 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 481/982] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:16 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:16.512168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:16.512963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:16.518927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:16.519735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:16.520274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:16.521045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:16.521700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:16.524710 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:16.528980 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:16.533334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-187570e4-7922-4e11-891c-bac657cb85a1 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.331260 Sep 15 00:53:16.533913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 502/983] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:16 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:16.660309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:16.668683 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9ce05805-90fe-4084-8fc2-974c744ea349 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.160633 Sep 15 00:53:16.669479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 482/984] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:16 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:16.869426 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-2b6b9409-7753-40d4-b6bb-e3950af8e4e1 req-dbb666b1-e50b-4bfe-bf7e-a45ed09238bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c186a1d3-16da-4f22-81e3-0e80c8fbd1fc", "tag": "216baa8c-c4e9-4ef8-b8ae-4f14fcd82ed2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:16.878995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2b6b9409-7753-40d4-b6bb-e3950af8e4e1 req-dbb666b1-e50b-4bfe-bf7e-a45ed09238bf service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:16.879467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2b6b9409-7753-40d4-b6bb-e3950af8e4e1 req-dbb666b1-e50b-4bfe-bf7e-a45ed09238bf service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:16.879943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2b6b9409-7753-40d4-b6bb-e3950af8e4e1 req-dbb666b1-e50b-4bfe-bf7e-a45ed09238bf service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:16.890679 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-2b6b9409-7753-40d4-b6bb-e3950af8e4e1 req-dbb666b1-e50b-4bfe-bf7e-a45ed09238bf service nova] Creating event network-changed:216baa8c-c4e9-4ef8-b8ae-4f14fcd82ed2 for instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc on hv-cinder-85752 Sep 15 00:53:16.896078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-2b6b9409-7753-40d4-b6bb-e3950af8e4e1 req-dbb666b1-e50b-4bfe-bf7e-a45ed09238bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030314 Sep 15 00:53:16.896653 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 503/985] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:17.528686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:17.529333 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:17.535785 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:17.536272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:17.536716 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:17.537413 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:17.537875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:17.538329 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:17.557227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:17.559219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:17.565566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:17.566133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:17.566493 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:17.567190 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:17.567680 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:17.568172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:17.689540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:17.699368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3b9591b3-9fce-441a-97c1-5f986d1c57b3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.174537 Sep 15 00:53:17.700429 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 483/986] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:17 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:17.705134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:17.705859 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:17.712148 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:17.712757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:17.713264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:17.714138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:17.714701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:17.715249 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:17.716588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:17.724205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d18168b7-ab57-4552-b40f-95c2656b5426 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.172350 Sep 15 00:53:17.724773 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 504/987] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:17 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:17.846762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:17.854523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5ce05d4c-eabc-45c4-9b90-74e30ce0a655 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.152942 Sep 15 00:53:17.855084 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 484/988] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:17 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:18.455808 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:18.456228 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:18.458173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:18.463415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.463945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.464378 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.465068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.465523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.465947 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.494377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8c811a92-07c0-4a86-ab61-858d43f59fc4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments/ff2e2a19-7d56-42f5-be4d-f334bbc51f18" status: 200 len: 194 microversion: 2.20 time: 0.042677 Sep 15 00:53:18.494955 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 505/989] 10.222.0.15 () {60 vars in 1454 bytes} [Thu Sep 15 00:53:18 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments/ff2e2a19-7d56-42f5-be4d-f334bbc51f18 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:53:18.564317 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:18.564852 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:18.572963 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.573556 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.574098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.574880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.575453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.576014 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.660551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lazy-loading 'services' on Instance uuid 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:53:18.724728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:18.726252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:18.737606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.738366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.739000 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.740024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.740774 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.741604 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.754352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-da1257f2-c2ea-461c-832a-d0cef3014185 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "DELETE /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments/ff2e2a19-7d56-42f5-be4d-f334bbc51f18" status: 202 len: 0 microversion: 2.20 time: 0.193656 Sep 15 00:53:18.758750 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 485/990] 10.222.0.15 () {60 vars in 1457 bytes} [Thu Sep 15 00:53:18 2022] DELETE /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments/ff2e2a19-7d56-42f5-be4d-f334bbc51f18 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:53:18.764039 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:18.765069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:18.772017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.772524 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.772970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.773690 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.774155 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.774591 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.916180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:18.924642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-92da5e4b-ecc7-4c69-b104-4e8c0397aa00 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.167424 Sep 15 00:53:18.925312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 486/991] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:18 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:18.930561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:18.933499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:18.939188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.939865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.940290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.941169 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.941498 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.941927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.961728 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:18.970815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-76680e2a-a06e-4367-a37b-3bb59abd1b61 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.252389 Sep 15 00:53:18.971399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 506/992] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:18 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:18.979217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:18.979457 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5027d213-9dc1-47f3-a2f3-dacbe54de248 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052813 Sep 15 00:53:18.980021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 487/993] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 15 00:53:18 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:53:18.980905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:18.987129 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.988573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.989376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:18.990095 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:18.991002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:18.991803 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:19.116181 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-455bfbe1-0f4b-4365-9f08-d99537f72ca0 req-0dca3f74-3201-4098-b17a-38ae41a3283c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e47eda5-dffe-41dd-a09d-0870d19dd898", "name": "network-vif-plugged", "status": "completed", "tag": "4cd61e51-9091-42e2-b4f8-f67dbf137235"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:19.126629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-455bfbe1-0f4b-4365-9f08-d99537f72ca0 req-0dca3f74-3201-4098-b17a-38ae41a3283c service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:19.127532 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-455bfbe1-0f4b-4365-9f08-d99537f72ca0 req-0dca3f74-3201-4098-b17a-38ae41a3283c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:19.127789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-455bfbe1-0f4b-4365-9f08-d99537f72ca0 req-0dca3f74-3201-4098-b17a-38ae41a3283c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:19.142271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:19.142588 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-455bfbe1-0f4b-4365-9f08-d99537f72ca0 req-0dca3f74-3201-4098-b17a-38ae41a3283c service nova] Creating event network-vif-plugged:4cd61e51-9091-42e2-b4f8-f67dbf137235 for instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 on hv-cinder-85752 Sep 15 00:53:19.147342 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-455bfbe1-0f4b-4365-9f08-d99537f72ca0 req-0dca3f74-3201-4098-b17a-38ae41a3283c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034887 Sep 15 00:53:19.148151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 488/994] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:19.151126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3d0709ad-1ad9-4e5f-9166-b90b4f38bfc3 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.178411 Sep 15 00:53:19.151756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 507/995] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:18 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:19.949722 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:19.950430 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:19.956524 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:19.957016 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:19.957489 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:19.958196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:19.958659 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:19.959092 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:19.994620 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:19.995938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:20.005063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.005920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.006530 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.007498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.007964 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.008392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.107931 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:20.116251 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d632c13e-ec33-441e-8e74-b0dc71eda38e tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.171937 Sep 15 00:53:20.116887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 489/996] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:19 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:20.123372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:20.125890 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:20.132870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.133376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.133818 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.134548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.135004 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.135539 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.170203 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7d2ca56e-a167-4591-a1bb-0751d27067cd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051936 Sep 15 00:53:20.170788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 490/997] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 15 00:53:20 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:53:20.175351 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:20.175912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:20.177754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:20.183492 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.183979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.184411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.185098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.185552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.185972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.291500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:20.300007 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-660b42bf-3f54-4bd3-a11d-0dc56869cc44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.309496 Sep 15 00:53:20.300581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 508/998] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:19 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:20.316889 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:20.319078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:20.326000 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5ef31e78-99d9-44f1-b640-df607e1cd5f1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1568 microversion: 2.1 time: 0.154279 Sep 15 00:53:20.326560 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 491/999] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:20 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:20.348512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:20.349100 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:20.355693 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.356116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.356545 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.357226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.357673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.358090 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.386529 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127199) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 00:53:20.456418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-36ca148a-ccf9-4d97-baea-4db51d87f133 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "POST /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b/action" status: 202 len: 0 microversion: 2.1 time: 0.111678 Sep 15 00:53:20.457206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 509/1000] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:53:20 2022] POST /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 00:53:20.465764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:20.466383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:20.469286 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=16 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:20.473542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.474037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.474479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.475182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:20.475671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:20.476101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:20.647918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:20.652032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:20.657593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-45f0a17f-65f9-4e42-8e72-fcc02b114276 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1516 microversion: 2.1 time: 0.196155 Sep 15 00:53:20.658514 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 492/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:20 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:21.139672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=8 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:21.144724 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:21.145333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:21.151832 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.152265 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.152704 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.153402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.153860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.154324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.167598 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-6d20fc2e-727d-4151-8a6e-4adb4f772acf req-8b537830-ee34-4405-ad69-3c5e4fafb753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c94a4-c708-4b2f-b8b1-fa336f60aa4b", "name": "network-vif-unplugged", "status": "completed", "tag": "f8e5a3ed-229c-4186-8197-286fa9b6a050"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:21.178376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-6d20fc2e-727d-4151-8a6e-4adb4f772acf req-8b537830-ee34-4405-ad69-3c5e4fafb753 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.178854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-6d20fc2e-727d-4151-8a6e-4adb4f772acf req-8b537830-ee34-4405-ad69-3c5e4fafb753 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.179311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-6d20fc2e-727d-4151-8a6e-4adb4f772acf req-8b537830-ee34-4405-ad69-3c5e4fafb753 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.191018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.compute.server_external_events [req-6d20fc2e-727d-4151-8a6e-4adb4f772acf req-8b537830-ee34-4405-ad69-3c5e4fafb753 service nova] Unable to find a host for instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b. Dropping event network-vif-unplugged {{(pid=127200) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 00:53:21.191933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-6d20fc2e-727d-4151-8a6e-4adb4f772acf req-8b537830-ee34-4405-ad69-3c5e4fafb753 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028963 Sep 15 00:53:21.192516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 493/1002] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 00:53:21.197049 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:21.199770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:21.205502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.205984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.206423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.207126 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.207601 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.208026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.237368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b2ae39d5-9d5e-495b-bc29-1e3c93861fa1 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043789 Sep 15 00:53:21.237934 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 494/1003] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 15 00:53:21 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:21.288925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:21.296608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9717bcb9-ea0d-42d4-9ac1-2a2c93f544eb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.157853 Sep 15 00:53:21.297153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 510/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:21 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:21.301297 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:21.301823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:21.308294 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.309729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.310194 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.311223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.311716 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.312143 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.321862 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:21.322475 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:21.330011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.330502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.330982 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.331718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.332259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.332737 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.339191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:53:21.419257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9faa7316-1dbf-402c-b90d-e9da0a843f3b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "DELETE /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 204 len: 0 microversion: 2.20 time: 0.121384 Sep 15 00:53:21.420167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 495/1005] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 15 00:53:21 2022] DELETE /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 00:53:21.429254 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:21.429958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:21.437283 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.437774 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.438210 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.438916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.439369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.439836 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.464342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:21.472108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-82ee2103-13fc-41fa-8f91-745da3bdc3d8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.153959 Sep 15 00:53:21.472830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 511/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:21 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:21.569397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:21.577862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:21.579290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:21.580476 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-085180fe-dab9-498f-a347-688b2e3607dc tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.155474 Sep 15 00:53:21.581028 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 496/1007] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:21 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:21.681271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:21.681893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:21.687839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.688326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.688764 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.689460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:21.689918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:21.690346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:21.816344 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:21.824650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-35c4dffd-cdbd-4ec4-9ed3-f9724cc8e4ff tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1516 microversion: 2.1 time: 0.147263 Sep 15 00:53:21.825207 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 512/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:21 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:22.319550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:22.320075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:22.327215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:22.327741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:22.328183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:22.328875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:22.329330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:22.329753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:22.463152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:22.471335 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-232c2bde-57f8-4865-8a5c-dfcfdb4fa777 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.155706 Sep 15 00:53:22.471924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 497/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:22 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:22.495201 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:22.495859 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:22.502701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:22.503194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:22.503690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:22.504393 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:22.504854 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:22.505279 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:22.606212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:22.606869 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:22.613627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:22.614142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:22.614580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:22.615407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:22.615987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:22.616505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:22.652880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:22.657493 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:22.663011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4d14f584-b7c8-4749-b5ea-795deef000c2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.171488 Sep 15 00:53:22.673236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 513/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:22 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:22.756520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:22.769337 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:22.770784 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:22.771992 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a3ac0db4-67b1-4bea-83fd-1e951c8b3ba3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.169764 Sep 15 00:53:22.772558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 498/1011] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:22 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:22.848005 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:22.848567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:22.855949 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:22.856438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:22.856874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:22.857567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:22.858022 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:22.858449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:22.985566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:22.993326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2566e0ae-56ff-426e-8dbf-803ad7e3d528 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1516 microversion: 2.1 time: 0.149696 Sep 15 00:53:22.993886 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 514/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:22 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:23.494215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:23.494757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:23.501624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:23.502116 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:23.502563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:23.503267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:23.503757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:23.504187 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:23.638416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:23.646828 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-07a33b24-dcb1-47a1-8c76-93caeebb893f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.156218 Sep 15 00:53:23.659587 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 499/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:23 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:23.685179 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:23.685801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:23.692186 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:23.692682 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:23.693121 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:23.693827 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:23.694286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:23.694716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:23.797430 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:23.798668 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:23.805319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:23.805803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:23.806233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:23.806926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:23.807383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:23.807838 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:23.827622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:23.835425 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7da0ce34-4dba-41e5-a545-6bfd85bf2149 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1367 microversion: 2.1 time: 0.154135 Sep 15 00:53:23.836014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 515/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:23 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:23.933688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:23.941714 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:23.943150 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:23.944321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-13250dd2-5f09-4bba-9683-5ac63b6b54a6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.150900 Sep 15 00:53:23.944875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 500/1015] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:23 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:24.017208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:24.017831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:24.023841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:24.024272 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:24.024719 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:24.025416 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:24.025877 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:24.026869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:24.152225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:24.159915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4d75751a-0eaf-4953-8c6c-3f3a6e9e819b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1516 microversion: 2.1 time: 0.146528 Sep 15 00:53:24.160475 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 516/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:24 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:24.669416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:24.670036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:24.677680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:24.678180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:24.678615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:24.679319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:24.679807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:24.680234 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:24.815373 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:24.823771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6dff8c3b-80f2-4612-84ea-bd312f890e9f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.157878 Sep 15 00:53:24.824336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 501/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:24 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:24.859129 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:24.859771 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:24.866144 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:24.866632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:24.867073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:24.867829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:24.868288 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:24.868715 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:24.970933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:24.971853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:24.977704 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:24.978317 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:24.978774 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:24.980127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:24.980580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:24.981010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:24.997200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:25.005725 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-44b0e9ce-7d9a-4cb3-986e-ba61bfcb0ed2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1557 microversion: 2.1 time: 0.150367 Sep 15 00:53:25.006382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 517/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:24 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:25.029195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:25.029813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:25.035818 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:25.036650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:25.036961 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:25.037769 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:25.038331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:25.038897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:25.133085 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:25.144783 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-af6f96f6-f673-47e5-bda1-d136d12106f1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120505 Sep 15 00:53:25.145147 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:25.145380 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 518/1019] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 00:53:25 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:25.147395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:25.148631 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-502a5b85-0afd-4153-8c1d-ac8cfc43e061 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.182019 Sep 15 00:53:25.149184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 502/1020] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:24 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:25.156956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-58933bc3-ec58-40f6-b0a6-e3a4ec258cf9 req-64f5327c-ee84-46fb-b79f-0a71e0bf0abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c186a1d3-16da-4f22-81e3-0e80c8fbd1fc", "name": "network-vif-plugged", "status": "completed", "tag": "216baa8c-c4e9-4ef8-b8ae-4f14fcd82ed2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:25.166250 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:25.170407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-58933bc3-ec58-40f6-b0a6-e3a4ec258cf9 req-64f5327c-ee84-46fb-b79f-0a71e0bf0abb service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:25.171178 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-58933bc3-ec58-40f6-b0a6-e3a4ec258cf9 req-64f5327c-ee84-46fb-b79f-0a71e0bf0abb service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:25.171903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-58933bc3-ec58-40f6-b0a6-e3a4ec258cf9 req-64f5327c-ee84-46fb-b79f-0a71e0bf0abb service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:25.186395 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-58933bc3-ec58-40f6-b0a6-e3a4ec258cf9 req-64f5327c-ee84-46fb-b79f-0a71e0bf0abb service nova] Creating event network-vif-plugged:216baa8c-c4e9-4ef8-b8ae-4f14fcd82ed2 for instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc on hv-cinder-85752 Sep 15 00:53:25.186632 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:25.187381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:25.192811 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-58933bc3-ec58-40f6-b0a6-e3a4ec258cf9 req-64f5327c-ee84-46fb-b79f-0a71e0bf0abb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039979 Sep 15 00:53:25.194232 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 519/1021] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:25.196841 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:25.197272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:25.198374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:25.199083 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:25.199708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:25.200134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:25.336233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:25.344935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c1228d6e-b53f-4649-8edd-ee3e332552b1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1518 microversion: 2.1 time: 0.163338 Sep 15 00:53:25.345685 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 503/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:25 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:25.846708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:25.847470 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:25.853641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:25.854134 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:25.854575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:25.855281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:25.855765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:25.856192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:26.175555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:26.176171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:26.183772 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:26.184261 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:26.184694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:26.185390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:26.185843 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:26.186263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:26.256646 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:26.265324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f024be55-96bc-4a29-8b29-9bc9afb334a0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.422755 Sep 15 00:53:26.265984 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 520/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:25 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:26.318379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:26.326769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:26.328385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:26.329681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6b1fb14f-e403-473a-8c7b-84d4056504c3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1722 microversion: 2.20 time: 0.158145 Sep 15 00:53:26.330323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 504/1024] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:26 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:26.368461 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:26.369192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:26.375566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:26.376150 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:26.376593 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:26.377294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:26.377754 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:26.378183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:26.866734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:26.875591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-06a38afa-2b16-438b-ab24-0518a58060d4 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1518 microversion: 2.1 time: 0.511101 Sep 15 00:53:26.876588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 521/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:26 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1518 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:27.087939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-7c9c0dd1-3076-4d8e-ab97-6d706c5020f1 req-f4241c39-45c2-4f47-afd5-b0a7f0300c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e47eda5-dffe-41dd-a09d-0870d19dd898", "tag": "4cd61e51-9091-42e2-b4f8-f67dbf137235"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:27.111577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-7c9c0dd1-3076-4d8e-ab97-6d706c5020f1 req-f4241c39-45c2-4f47-afd5-b0a7f0300c82 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:27.112071 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-7c9c0dd1-3076-4d8e-ab97-6d706c5020f1 req-f4241c39-45c2-4f47-afd5-b0a7f0300c82 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:27.112512 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-7c9c0dd1-3076-4d8e-ab97-6d706c5020f1 req-f4241c39-45c2-4f47-afd5-b0a7f0300c82 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:27.137116 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-7c9c0dd1-3076-4d8e-ab97-6d706c5020f1 req-f4241c39-45c2-4f47-afd5-b0a7f0300c82 service nova] Creating event network-changed:4cd61e51-9091-42e2-b4f8-f67dbf137235 for instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 on hv-cinder-85752 Sep 15 00:53:27.145173 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-7c9c0dd1-3076-4d8e-ab97-6d706c5020f1 req-f4241c39-45c2-4f47-afd5-b0a7f0300c82 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060336 Sep 15 00:53:27.146006 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 505/1026] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:27.290319 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:27.293670 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:27.311175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:27.311712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:27.312160 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:27.312884 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:27.313345 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:27.313777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:27.357151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:27.358444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:27.393191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:27.396637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:27.399028 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:27.401007 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:27.402180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:27.404029 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:27.551157 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:27.552165 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:27.563862 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c67fbad3-75fa-4ba2-9e59-f296f1575a13 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1362 microversion: 2.1 time: 0.278584 Sep 15 00:53:27.564450 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 522/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:27 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:27.565136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:27.566783 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:27.568193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9501d5db-51dc-4456-9db5-d7e1d6ac4878 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1656 microversion: 2.20 time: 0.215515 Sep 15 00:53:27.587360 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 506/1028] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:27 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1656 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:27.901039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:27.901873 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:27.910407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:27.912831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:27.913516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:27.915520 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:27.919167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:27.919911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:28.148856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:28.170039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f77f21ba-c3fe-4529-80e1-0e3c5615af3f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.274030 Sep 15 00:53:28.170977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 523/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:27 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:28.590495 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:28.591156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:28.594526 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:28.595147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:28.598476 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:28.598978 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:28.599590 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:28.600322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:28.600927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:28.601168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:28.601369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:28.601584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:28.602035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:28.602750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:28.603209 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:28.603677 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:28.638578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:28.639065 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:28.639533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:28.639995 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lazy-loading 'fault' on Instance uuid 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:53:28.681788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:28.691033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:28.692523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:28.693705 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4d8e6104-9ea7-448c-a590-264ff8ce80d5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 200 len: 1371 microversion: 2.20 time: 0.103362 Sep 15 00:53:28.694273 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 524/1030] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:28 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:28.744540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:28.752686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e1c41943-2e79-4a38-8cbc-67c9ff8a3dd6 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1547 microversion: 2.1 time: 0.166460 Sep 15 00:53:28.753256 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 507/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:28 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:28.775222 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:28.776261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:28.782749 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:28.783241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:28.783782 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:28.784489 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:28.784946 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:28.785367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:28.953291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-41d548ca-f38b-40a1-94ea-8be0d8819820 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181926 Sep 15 00:53:28.954383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 525/1032] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 00:53:28 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:29.179211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-df87b7e1-ff30-4be8-a0c8-3292a7dc7130 req-e8d4dc31-8601-4673-942a-71103a5d5505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "469fcc1e-0231-4642-b72f-c2bf7fd7eb07", "name": "network-vif-deleted", "tag": "86077b58-abc6-43a7-9b01-51a893794c4e"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:29.191221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-df87b7e1-ff30-4be8-a0c8-3292a7dc7130 req-e8d4dc31-8601-4673-942a-71103a5d5505 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.191728 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-df87b7e1-ff30-4be8-a0c8-3292a7dc7130 req-e8d4dc31-8601-4673-942a-71103a5d5505 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.192215 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-df87b7e1-ff30-4be8-a0c8-3292a7dc7130 req-e8d4dc31-8601-4673-942a-71103a5d5505 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:29.195174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:29.196136 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:29.202610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.203498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.203693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-df87b7e1-ff30-4be8-a0c8-3292a7dc7130 req-e8d4dc31-8601-4673-942a-71103a5d5505 service nova] Creating event network-vif-deleted:86077b58-abc6-43a7-9b01-51a893794c4e for instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 on hv-cinder-85752 Sep 15 00:53:29.204215 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:29.204981 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.205779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.206398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:29.211358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-df87b7e1-ff30-4be8-a0c8-3292a7dc7130 req-e8d4dc31-8601-4673-942a-71103a5d5505 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035872 Sep 15 00:53:29.212161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 508/1033] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:29.384590 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:29.392538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ac1d5216-f713-4262-a7a1-71c7c6aefbfe tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.202315 Sep 15 00:53:29.393100 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 526/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:29 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:29.719985 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:29.720681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:29.727075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.727588 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.728025 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:29.728725 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.729668 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.730162 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:29.745578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] HTTP exception thrown: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Request method failure captured: Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 HTTP/1.1 Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInYB2mhtQqxcB1QREGjisNPQk6LTwf4voc_jcXMpNSHSSUVNzDzJoyQDYY8vSNBnep78M9nl6h20vnyLd8ZWjYbVhylXCFwH_UQwmdB9dFs0Qlo6_no3CNjN0zAj2aTc6ky21QZLTahcNwm4t9Z5EcrCRDhIoDCkZjKa__MdSSJKXq0 Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:53:29.747226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_72d7dfe402c045edbca04c0e7eee05f9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/72d7dfe402c045edbca04c0e7eee05f9"}]}] Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 36e8e45674624c219b59abb39d8dcf83 Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:53:29.748969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '469fcc1e-0231-4642-b72f-c2bf7fd7eb07'} Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:53:29.750082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:53:29.751348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:29.752550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Returning 404 to user: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:53:29.752550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-dc9c8d8b-a8ba-41d3-a89e-5e4a3439ea3f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 404 len: 111 microversion: 2.20 time: 0.033562 Sep 15 00:53:29.752550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 509/1035] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:29 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:53:29.757978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4aa0489b-9655-4dda-93c0-1d4421fdc121 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '.version_select at 0x7f2f207b2820>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:29.769026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:29.769522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:29.775368 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.775916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.776432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:29.777058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.777517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.777937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:29.778818 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4aa0489b-9655-4dda-93c0-1d4421fdc121 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-560269850" status: 204 len: 0 microversion: 2.20 time: 0.024655 Sep 15 00:53:29.779730 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 527/1036] 10.222.0.15 () {60 vars in 1259 bytes} [Thu Sep 15 00:53:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-560269850 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 00:53:29.805348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:29.814805 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:53:29.903912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-949a999c-a06f-47c4-b103-14fc20e73c85 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "DELETE /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 204 len: 0 microversion: 2.1 time: 0.138370 Sep 15 00:53:29.907892 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 510/1037] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:53:29 2022] DELETE /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 00:53:29.913923 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:29.915075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:29.925154 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.925874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.926273 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:29.926999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:29.928516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:29.929490 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:30.208619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:30.220333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-029aea09-c021-48a0-8a37-9de74dab1cb2 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1574 microversion: 2.1 time: 0.310937 Sep 15 00:53:30.221213 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-18953390-5483-4a75-bd9f-4c804b2062ec req-b760ea79-bbd9-405d-8b24-2895e27363ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c186a1d3-16da-4f22-81e3-0e80c8fbd1fc", "tag": "216baa8c-c4e9-4ef8-b8ae-4f14fcd82ed2"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:30.231431 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-18953390-5483-4a75-bd9f-4c804b2062ec req-b760ea79-bbd9-405d-8b24-2895e27363ee service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:30.232184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-18953390-5483-4a75-bd9f-4c804b2062ec req-b760ea79-bbd9-405d-8b24-2895e27363ee service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:30.232769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-18953390-5483-4a75-bd9f-4c804b2062ec req-b760ea79-bbd9-405d-8b24-2895e27363ee service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:30.235158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 528/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:29 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1574 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:30.247418 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-18953390-5483-4a75-bd9f-4c804b2062ec req-b760ea79-bbd9-405d-8b24-2895e27363ee service nova] Creating event network-changed:216baa8c-c4e9-4ef8-b8ae-4f14fcd82ed2 for instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc on hv-cinder-85752 Sep 15 00:53:30.253167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-18953390-5483-4a75-bd9f-4c804b2062ec req-b760ea79-bbd9-405d-8b24-2895e27363ee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036072 Sep 15 00:53:30.253771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 511/1039] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:30.418285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:30.419602 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:30.429524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:30.430134 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:30.430920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:30.431738 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:30.432286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:30.432775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:30.570122 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b0f1e0a3-a522-47b8-84b0-cab337e3537e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'create', calling method: .version_select at 0x7f2f1d092700>, body: {"keypair": {"name": "tempest-keypair-766892730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEujGl0T279NsWwAYu+Rvkxf3QwssRNFmlxSGfTfI8NpIWIJk7zj58U1Z/oMxMMjVIzvKQMh3EZ8M8cZVCvd/+TVhn/40Cb+9jLTVEYkjIKC5IyR2s3FSPeLFa5IlrYCA=="}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:30.586981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-b0f1e0a3-a522-47b8-84b0-cab337e3537e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Getting quotas for project 72d7dfe402c045edbca04c0e7eee05f9. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:53:30.589635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:30.591899 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-b0f1e0a3-a522-47b8-84b0-cab337e3537e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Getting quotas for user 36e8e45674624c219b59abb39d8dcf83 and project 72d7dfe402c045edbca04c0e7eee05f9. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:53:30.597345 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a1612a15-d78a-4052-84e6-bd8c3423d66f tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.184859 Sep 15 00:53:30.612203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 529/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:30 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:30.619715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b0f1e0a3-a522-47b8-84b0-cab337e3537e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.054954 Sep 15 00:53:30.620544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 512/1041] 10.222.0.15 () {62 vars in 1200 bytes} [Thu Sep 15 00:53:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 00:53:31.246262 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:31.246823 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:31.253643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:31.254129 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:31.254566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:31.255289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:31.255770 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:31.256191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:31.508657 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:31.517419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-caa79729-1d38-41f6-a314-e3dddd5fe98b tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1574 microversion: 2.1 time: 0.275308 Sep 15 00:53:31.518009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 530/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:31 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1574 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:31.623193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:31.623953 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:31.630271 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:31.630757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:31.631199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:31.631926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:31.632636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:31.633064 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:31.782076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:31.790206 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-226f57c4-2110-4eb0-906a-4ed003c33957 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.171971 Sep 15 00:53:31.790798 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 513/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:31 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:32.541761 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:32.542463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:32.548949 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:32.549437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:32.549869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:32.550570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:32.551134 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:32.551446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:32.699908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1738122608", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab876c33-1fa1-4628-a9be-d8dde255d344"}], "security_groups": [{"name": "tempest-securitygroup--528741494"}], "key_name": "tempest-keypair-766892730", "user_data": "}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:32.803882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] validate_networks() for [('ab876c33-1fa1-4628-a9be-d8dde255d344', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:53:32.876161 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:32.885543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4db1d3c5-3e14-4ff8-8797-d4c618cdc2f8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1574 microversion: 2.1 time: 0.347563 Sep 15 00:53:32.886119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 531/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:32 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1574 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:32.891289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:32.892124 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:32.898087 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:32.898844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:32.899514 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:32.900540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:32.901233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:32.901731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:32.921408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:33.131143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:33.140803 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c5b0322a-d3e3-4591-933b-ca6d4720ea96 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.253218 Sep 15 00:53:33.141717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 532/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:32 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:33.209965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:53:33.211274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:53:33.211893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:53:33.212317 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:53:33.212740 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:53:33.222752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:33.223247 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:33.223741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:33.224491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:33.224953 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:33.225393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:33.248095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Getting quotas for project 72d7dfe402c045edbca04c0e7eee05f9. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:53:33.252741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Getting quotas for user 36e8e45674624c219b59abb39d8dcf83 and project 72d7dfe402c045edbca04c0e7eee05f9. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:53:33.266046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:53:33.268402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:53:33.316372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9020fd1d-2282-4699-87d7-ea1cbb6369ae tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.620447 Sep 15 00:53:33.317194 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 514/1046] 10.222.0.15 () {62 vars in 1188 bytes} [Thu Sep 15 00:53:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 15 00:53:33.329204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8a96714b-091d-4324-81d4-30d0718a381b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:33.329816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8a96714b-091d-4324-81d4-30d0718a381b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:33.428212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8a96714b-091d-4324-81d4-30d0718a381b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:33.436297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8a96714b-091d-4324-81d4-30d0718a381b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:33.437755 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8a96714b-091d-4324-81d4-30d0718a381b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:33.438871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8a96714b-091d-4324-81d4-30d0718a381b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1281 microversion: 2.20 time: 0.113788 Sep 15 00:53:33.439523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 533/1047] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:33 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:33.549890 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-c44cfcc6-d454-491f-9a13-84e959ef466b req-5ee389f6-3788-4a87-aded-c03c1910e751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c86872-2309-4e4c-88ad-e5b9c7166dd3", "name": "network-vif-deleted", "tag": "17d11138-3b63-47b5-8935-04d6fc868545"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:33.565784 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-c44cfcc6-d454-491f-9a13-84e959ef466b req-5ee389f6-3788-4a87-aded-c03c1910e751 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:33.567341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-c44cfcc6-d454-491f-9a13-84e959ef466b req-5ee389f6-3788-4a87-aded-c03c1910e751 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:33.568085 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-c44cfcc6-d454-491f-9a13-84e959ef466b req-5ee389f6-3788-4a87-aded-c03c1910e751 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:33.593649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-c44cfcc6-d454-491f-9a13-84e959ef466b req-5ee389f6-3788-4a87-aded-c03c1910e751 service nova] Creating event network-vif-deleted:17d11138-3b63-47b5-8935-04d6fc868545 for instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 on hv-cinder-85752 Sep 15 00:53:33.598780 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-c44cfcc6-d454-491f-9a13-84e959ef466b req-5ee389f6-3788-4a87-aded-c03c1910e751 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053038 Sep 15 00:53:33.599378 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 515/1048] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:33.908811 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:33.909438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:33.916943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:33.917436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:33.917878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:33.918638 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:33.919290 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:33.920146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:34.008797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:34.016559 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c3491248-cca4-4a57-9f98-52218ef0c098 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1224 microversion: 2.1 time: 0.111572 Sep 15 00:53:34.017134 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 534/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:33 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:34.164576 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:34.165352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:34.172529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:34.173023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:34.173486 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:34.174192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:34.174940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:34.175374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:34.321905 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:34.329776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b1593f9e-a7d7-4478-ac26-006de4430bcb tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.169360 Sep 15 00:53:34.330349 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 516/1050] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:34 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:34.464833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:34.465505 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:34.471612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:34.472101 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:34.472541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:34.473236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:34.473692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:34.474126 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:34.536847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:34.545032 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:34.546570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:34.547789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cf48fd12-c54f-4a08-a9f2-c396dbcf1653 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1333 microversion: 2.20 time: 0.087497 Sep 15 00:53:34.548430 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 535/1051] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:34 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:35.042225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:35.043453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:35.049917 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:35.050422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:35.050874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:35.051636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:35.052101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:35.052563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:35.085580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:35.086050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:35.086490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:35.086953 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lazy-loading 'fault' on Instance uuid 42c86872-2309-4e4c-88ad-e5b9c7166dd3 {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:53:35.129808 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:35.138289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-14d2fbfb-1e73-41ac-a256-1d7d6ee9a8ba tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1229 microversion: 2.1 time: 0.100049 Sep 15 00:53:35.138875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 517/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:35 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:35.353024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:35.353682 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:35.361421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:35.361966 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:35.362412 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:35.363167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:35.363664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:35.364143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:35.573544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:35.574932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:35.581461 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:35.582032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:35.582552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:35.585540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:35.589754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:35.590043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:35.590483 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:35.594254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-951686da-6b01-421c-b6f7-7758f90b903c tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.244876 Sep 15 00:53:35.595768 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 536/1053] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:35 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:35.736365 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:35.746291 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:35.748452 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:35.750444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-84535c57-898b-49c7-9caa-2f0ec364e5d0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.180665 Sep 15 00:53:35.751018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 518/1054] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:35 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:36.161863 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:36.162409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:36.168979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:36.169463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:36.169894 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:36.170584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:36.171038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:36.171467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:36.201072 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:36.201543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:36.201970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:36.202407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lazy-loading 'fault' on Instance uuid 42c86872-2309-4e4c-88ad-e5b9c7166dd3 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:53:36.242962 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:36.251636 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f1019c72-f85e-4532-bef9-92317b630cb6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 200 len: 1229 microversion: 2.1 time: 0.093346 Sep 15 00:53:36.252196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 537/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:36 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:36.617454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:36.618077 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:36.625061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:36.625552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:36.625995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:36.626701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:36.627177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:36.627627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:36.777905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:36.779067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:36.780121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:36.788586 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5162cd35-5d54-4985-9996-7d4635054097 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.175039 Sep 15 00:53:36.791324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:36.791849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:36.795278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:36.796328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:36.796794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:36.797235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:36.804705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 519/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:36 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:36.996837 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:37.007002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:37.008555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:37.009744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7db25bf7-4f22-4357-a991-ad494e81a3b3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.236594 Sep 15 00:53:37.010482 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 538/1057] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:36 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:37.091695 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-845e7714-3416-4b16-b486-6f5945859537 req-14c1457a-da20-4fcd-8fb2-6b7a389e6b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c270acf-24d9-4d2e-bf97-2f487bd44a96", "tag": "9e2fa835-2b12-4126-9efe-5387a46e4c0c"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:37.101962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-845e7714-3416-4b16-b486-6f5945859537 req-14c1457a-da20-4fcd-8fb2-6b7a389e6b87 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:37.102708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-845e7714-3416-4b16-b486-6f5945859537 req-14c1457a-da20-4fcd-8fb2-6b7a389e6b87 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:37.104417 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-845e7714-3416-4b16-b486-6f5945859537 req-14c1457a-da20-4fcd-8fb2-6b7a389e6b87 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:37.116525 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-845e7714-3416-4b16-b486-6f5945859537 req-14c1457a-da20-4fcd-8fb2-6b7a389e6b87 service nova] Creating event network-changed:9e2fa835-2b12-4126-9efe-5387a46e4c0c for instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 on hv-cinder-85752 Sep 15 00:53:37.122075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-845e7714-3416-4b16-b486-6f5945859537 req-14c1457a-da20-4fcd-8fb2-6b7a389e6b87 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035816 Sep 15 00:53:37.122667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 520/1058] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:37.274146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:37.274765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:37.280744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:37.281236 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:37.281681 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:37.282384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:37.282843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:37.283290 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:37.296623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] HTTP exception thrown: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Request method failure captured: Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 HTTP/1.1 Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInaDE_ROE34nHoRQmFXLIGCxGhmBDzx5igFLmHnB1uUoKzc_sN65y5Txyztrv7sCTkysb0cj3NzFWv7x6MgNnOVMPdnFAjOwhu7CYUbSNr-_h-eG1lQHZgPYTJwtBKAlUN9QxLKYIjVuHoQVddGJYUiGTKEcOvpI6h2kqlFs_HNpP8g Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:53:37.298327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_53d8d76185c44a159439c0f7a0e88b31", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/53d8d76185c44a159439c0f7a0e88b31"}]}] Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestVolumeBootPattern-168526169 Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: d308262224af475091e6aa494ea839b1 Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:53:37.299970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '42c86872-2309-4e4c-88ad-e5b9c7166dd3'} Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:53:37.300887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:53:37.302363 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:37.303603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Returning 404 to user: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:53:37.303603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-54c5d08a-1554-4b75-b475-0c52fa01ddc6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 404 len: 111 microversion: 2.1 time: 0.029496 Sep 15 00:53:37.303603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 539/1059] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:37 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:53:37.397500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1086408102", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-309604362", "security_groups": [{"name": "tempest-secgroup-smoke-305757992"}], "block_device_mapping_v2": [{"uuid": "96fc9de6-4298-4b9e-b043-b5167658344e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0487b0cb-031a-4188-bee6-95c6ebd2b4a3"}]}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:37.409110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:37.517977 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] validate_networks() for [('0487b0cb-031a-4188-bee6-95c6ebd2b4a3', None, None, None, None, None)] {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:53:37.812188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:37.812801 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:37.819544 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:37.820253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:37.820689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:37.821404 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:37.821866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:37.822474 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:37.898108 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:53:37.898596 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:53:37.899023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:53:37.899433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:53:37.899891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:53:37.909158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:37.909647 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:37.910090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:37.910833 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:37.911294 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:37.911754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:37.929360 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Getting quotas for project 53d8d76185c44a159439c0f7a0e88b31. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:53:37.933476 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Getting quotas for user d308262224af475091e6aa494ea839b1 and project 53d8d76185c44a159439c0f7a0e88b31. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:53:37.957585 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:37.965893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1c9317c6-f086-4b89-9f5d-4b08e931c2d1 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.158028 Sep 15 00:53:37.966454 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 540/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:37 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:37.991309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:53:37.993594 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96fc9de6-4298-4b9e-b043-b5167658344e',volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:53:38.036243 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:38.036863 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:38.044299 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:38.044802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:38.045252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:38.045957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:38.046472 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:38.046912 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:38.129384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a910988b-6471-4fb6-bbab-a5dbd49bea7f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.736687 Sep 15 00:53:38.130355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 521/1061] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:53:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 00:53:38.141775 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7a6c29b6-4c44-4f65-937a-af24b5f28862 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:38.142487 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7a6c29b6-4c44-4f65-937a-af24b5f28862 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:38.215956 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7a6c29b6-4c44-4f65-937a-af24b5f28862 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:38.223151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7a6c29b6-4c44-4f65-937a-af24b5f28862 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1094 microversion: 2.1 time: 0.085276 Sep 15 00:53:38.223958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 522/1062] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:38 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:38.415266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:38.423723 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:38.425181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:38.426623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-75687ab4-cab4-4448-aee0-20035021a402 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.395050 Sep 15 00:53:38.427316 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 541/1063] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:38 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:38.989165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:38.989730 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:38.997556 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:38.998067 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:38.998502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:38.999188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:38.999929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:39.000351 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:39.135686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:39.144095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5ff98241-b6a8-4214-9f12-c7aaf5930d64 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.158832 Sep 15 00:53:39.144657 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 523/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:38 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:39.177672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-71b2ac8a-1220-406b-8e72-f39922201cdc req-18bc0803-2fd1-41ea-8da6-a86375da1b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c94a4-c708-4b2f-b8b1-fa336f60aa4b", "name": "network-vif-plugged", "status": "completed", "tag": "f8e5a3ed-229c-4186-8197-286fa9b6a050"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:39.188548 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-71b2ac8a-1220-406b-8e72-f39922201cdc req-18bc0803-2fd1-41ea-8da6-a86375da1b68 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:39.189050 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-71b2ac8a-1220-406b-8e72-f39922201cdc req-18bc0803-2fd1-41ea-8da6-a86375da1b68 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:39.189476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-71b2ac8a-1220-406b-8e72-f39922201cdc req-18bc0803-2fd1-41ea-8da6-a86375da1b68 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:39.201273 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-71b2ac8a-1220-406b-8e72-f39922201cdc req-18bc0803-2fd1-41ea-8da6-a86375da1b68 service nova] Creating event network-vif-plugged:f8e5a3ed-229c-4186-8197-286fa9b6a050 for instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b on hv-cinder-85752 Sep 15 00:53:39.206093 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-71b2ac8a-1220-406b-8e72-f39922201cdc req-18bc0803-2fd1-41ea-8da6-a86375da1b68 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032173 Sep 15 00:53:39.206671 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 542/1065] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:39.246338 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:39.246984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:39.253381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:39.253870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:39.254309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:39.255006 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:39.255462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:39.255910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:39.318485 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:39.327005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5d4b5dd5-318a-48ef-99ea-cb8333840d5c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1144 microversion: 2.1 time: 0.084707 Sep 15 00:53:39.327591 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 524/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:39 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:39.453617 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:39.454323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:39.463840 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:39.464327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:39.464767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:39.465461 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:39.465934 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:39.466370 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:39.592355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:39.600640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:39.602124 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:39.603230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-eeb3a71a-d8b8-4fd9-94c1-bb06e6043909 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.154580 Sep 15 00:53:39.603820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 543/1067] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:39 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:40.168377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:40.169019 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:40.175419 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:40.175944 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:40.176387 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:40.178561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:40.179221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:40.180045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:40.337349 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:40.347828 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-06a105aa-30b1-4ab4-b879-6c82df07ac6b tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.183829 Sep 15 00:53:40.348750 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 525/1068] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:40 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:40.367257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:40.370206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:40.378814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:40.379341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:40.379945 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:40.380664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:40.381120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:40.381548 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:40.497924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:40.507700 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f6b522ef-afa9-4645-bb52-abbde515250a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1192 microversion: 2.1 time: 0.159419 Sep 15 00:53:40.508626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 544/1069] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:40 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1192 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:40.628672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:40.629281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:40.635225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:40.635741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:40.636683 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:40.637396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:40.637845 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:40.638269 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:40.768319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:40.776322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:40.778383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:40.779520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-63b1f000-e9fe-40d8-a357-7b519dbd4aa3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.154982 Sep 15 00:53:40.780083 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 526/1070] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:40 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:41.375983 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:41.376598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:41.382872 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:41.383354 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:41.383829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:41.384522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:41.384977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:41.385402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:41.513226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:41.520795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c78a8e37-372a-4fe0-a592-a24068149963 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1574 microversion: 2.1 time: 0.149097 Sep 15 00:53:41.521353 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 545/1071] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:41 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:41.531745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:41.532912 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:41.539269 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:41.539791 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:41.540234 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:41.540935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:41.541421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:41.541853 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:41.602804 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:41.610497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6ea77012-be3f-4906-9caa-0fa210809cb8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1192 microversion: 2.1 time: 0.082634 Sep 15 00:53:41.611097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 527/1072] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:41 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:41.804200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:41.804816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:41.811379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:41.811899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:41.812335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:41.813033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:41.813487 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:41.813911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:41.944364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:41.952924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:41.954347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:41.955446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-724d1c2d-bbf8-4d50-b699-203b3e2a07e7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.155193 Sep 15 00:53:41.956028 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 546/1073] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:41 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:42.544755 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:42.545382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:42.551868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:42.552358 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:42.552803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:42.553505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:42.553967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:42.554403 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:42.633611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:42.634290 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:42.640780 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:42.641274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:42.641718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:42.642429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:42.642895 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:42.643328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:42.696528 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:42.704844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fb632977-a6d5-4719-92f6-76750d0e77be tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1561 microversion: 2.1 time: 0.164413 Sep 15 00:53:42.705635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 528/1074] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:42 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:42.720528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:42.728567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-33777a57-28ae-4d7e-b32d-1ab0c4327453 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1200 microversion: 2.1 time: 0.098860 Sep 15 00:53:42.729324 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 547/1075] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:42 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:42.983423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:42.984159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:42.990113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:42.990600 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:42.991042 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:42.991776 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:42.992237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:42.992663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:43.133430 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:43.143205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:43.144684 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:43.146074 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d2db5a71-8206-41ad-a068-f10813b996c5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.166824 Sep 15 00:53:43.147032 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 529/1076] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:42 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:43.753418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:43.754641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:43.758192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:43.763693 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:43.764188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:43.764623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:43.765329 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:43.765818 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:43.766208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:43.945381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:43.953656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-75af750c-e0e5-420a-b5d5-74696df31a17 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.205075 Sep 15 00:53:43.954226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 548/1077] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:43 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:44.172138 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:44.172748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:44.179137 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:44.179686 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:44.180127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:44.180828 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:44.181312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:44.181739 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:44.200265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:44.294316 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2018014068"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:44.295234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:44.303243 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:44.304018 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:44.304460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:44.305371 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:44.306079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:44.306673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:44.322013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:44.337530 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:44.339177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:44.340627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1504c28d-a4d1-4d7a-a5fe-5bf179ac83e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.172496 Sep 15 00:53:44.351582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 530/1078] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:44 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:44.351582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-1d1afad1-0ae3-403c-9a8a-18f6730e91a6 req-7f74329f-c873-4f3f-9274-4820e9062aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c770ee1-1cc8-4af3-bb2c-ab3753156e37", "tag": "d1b21f4d-7863-4a9c-ac7d-ae028778c2c8"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:44.359819 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-1d1afad1-0ae3-403c-9a8a-18f6730e91a6 req-7f74329f-c873-4f3f-9274-4820e9062aa4 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:44.360184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-1d1afad1-0ae3-403c-9a8a-18f6730e91a6 req-7f74329f-c873-4f3f-9274-4820e9062aa4 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:44.360614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-1d1afad1-0ae3-403c-9a8a-18f6730e91a6 req-7f74329f-c873-4f3f-9274-4820e9062aa4 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:44.372633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-1d1afad1-0ae3-403c-9a8a-18f6730e91a6 req-7f74329f-c873-4f3f-9274-4820e9062aa4 service nova] Creating event network-changed:d1b21f4d-7863-4a9c-ac7d-ae028778c2c8 for instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 on hv-cinder-85752 Sep 15 00:53:44.378110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-1d1afad1-0ae3-403c-9a8a-18f6730e91a6 req-7f74329f-c873-4f3f-9274-4820e9062aa4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032737 Sep 15 00:53:44.378646 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 531/1079] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:44.496844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.network.security_group_api [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Removing security group ae1e1c03-b28b-4d7c-bcba-4af71d500af6 from port cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 Sep 15 00:53:44.977416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:44.978197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:44.985187 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:44.985760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:44.986287 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:44.987056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:44.987612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:44.988104 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:45.057513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dafcb5ba-6b1f-43b1-8a6f-76655523e709 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "POST /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/action" status: 202 len: 0 microversion: 2.1 time: 0.767028 Sep 15 00:53:45.058953 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 549/1080] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 15 00:53:44 2022] POST /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/action => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:53:45.193124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:45.202566 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d3dfd209-4276-4d5f-9a0c-d256f5de0f20 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.229367 Sep 15 00:53:45.216296 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 532/1081] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:44 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:45.366868 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:45.367707 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:45.375406 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:45.376132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:45.376574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:45.377317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:45.377939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:45.378657 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:45.417080 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-a110ea47-638f-49f4-bb5b-26be441f9e1f req-340d55e8-8bd4-4b05-ba22-574a738b6e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c270acf-24d9-4d2e-bf97-2f487bd44a96", "name": "network-vif-plugged", "status": "completed", "tag": "9e2fa835-2b12-4126-9efe-5387a46e4c0c"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:45.432840 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a110ea47-638f-49f4-bb5b-26be441f9e1f req-340d55e8-8bd4-4b05-ba22-574a738b6e10 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:45.433451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a110ea47-638f-49f4-bb5b-26be441f9e1f req-340d55e8-8bd4-4b05-ba22-574a738b6e10 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:45.433960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a110ea47-638f-49f4-bb5b-26be441f9e1f req-340d55e8-8bd4-4b05-ba22-574a738b6e10 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:45.445733 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-a110ea47-638f-49f4-bb5b-26be441f9e1f req-340d55e8-8bd4-4b05-ba22-574a738b6e10 service nova] Creating event network-vif-plugged:9e2fa835-2b12-4126-9efe-5387a46e4c0c for instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 on hv-cinder-85752 Sep 15 00:53:45.451102 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-a110ea47-638f-49f4-bb5b-26be441f9e1f req-340d55e8-8bd4-4b05-ba22-574a738b6e10 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038632 Sep 15 00:53:45.451831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 533/1082] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:45.578779 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:45.587977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:45.589737 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:45.590873 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b033ba42-eda2-4db4-8e7c-d3b99d20fbc5 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.228616 Sep 15 00:53:45.608482 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 550/1083] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:45 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:46.227616 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:46.228252 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:46.234939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.235472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.236108 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.236826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.237290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.237724 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.376547 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:46.384420 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e3e4f4c0-f267-4db8-802f-46ad80b86cf0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.161903 Sep 15 00:53:46.385018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 534/1084] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:46 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:46.414418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-15366224-43b7-4f52-bfef-a8853fdd4cd1 req-12b72871-de91-421e-b492-67ac42873888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adedf981-66a2-455b-8192-1852eea1312b", "tag": "cc2b33ab-216b-4ead-83c4-eee6a3d2ec41"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:46.425838 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-15366224-43b7-4f52-bfef-a8853fdd4cd1 req-12b72871-de91-421e-b492-67ac42873888 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.426405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-15366224-43b7-4f52-bfef-a8853fdd4cd1 req-12b72871-de91-421e-b492-67ac42873888 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.426905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-15366224-43b7-4f52-bfef-a8853fdd4cd1 req-12b72871-de91-421e-b492-67ac42873888 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.439061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-15366224-43b7-4f52-bfef-a8853fdd4cd1 req-12b72871-de91-421e-b492-67ac42873888 service nova] Creating event network-changed:cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 for instance adedf981-66a2-455b-8192-1852eea1312b on hv-cinder-85752 Sep 15 00:53:46.445195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-15366224-43b7-4f52-bfef-a8853fdd4cd1 req-12b72871-de91-421e-b492-67ac42873888 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Sep 15 00:53:46.446579 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 551/1085] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:46.532306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:46.533175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:46.540410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.541131 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.541745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.543635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.544433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.545205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.618015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:46.619064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:46.627551 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.628301 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.628747 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.629465 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.630052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.630786 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.635257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:46.641275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lazy-loading 'services' on Instance uuid adedf981-66a2-455b-8192-1852eea1312b {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:53:46.723980 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3794fdfc-840b-48fc-a15d-c97e4414589e tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "DELETE /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments/07ac5281-d3af-4cbf-b468-35ebc5f694d8" status: 202 len: 0 microversion: 2.1 time: 0.196977 Sep 15 00:53:46.724760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 535/1086] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:53:46 2022] DELETE /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments/07ac5281-d3af-4cbf-b468-35ebc5f694d8 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:53:46.733408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:46.736105 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:46.742654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.743158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.743639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.744430 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:46.744895 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:46.745865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:46.778435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c57b6302-bf24-4779-a563-42c265c5c157 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049083 Sep 15 00:53:46.779371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 536/1087] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:53:46 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:46.784780 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:46.793419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:46.794851 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:46.795984 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b50992a3-9951-4c91-be50-75707593cdac tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.183560 Sep 15 00:53:46.796537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 552/1088] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:46 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:47.406214 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:47.406939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:47.413262 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:47.413755 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:47.414212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:47.414981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:47.415441 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:47.415892 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:47.554051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:47.562582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9a19b97e-e2f2-4c8d-b1d9-115e37355dec tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.160147 Sep 15 00:53:47.563192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 537/1089] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:47 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:47.790804 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:47.793970 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:47.801066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:47.801569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:47.802192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:47.803084 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:47.803746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:47.804252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:47.820568 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:47.821089 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:47.827807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:47.828288 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:47.828906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:47.829610 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:47.830227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:47.830821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:47.837906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e328da28-27c5-494a-a247-0d4684f8e26f tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051412 Sep 15 00:53:47.838485 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 553/1090] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:53:47 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:47.920722 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=4 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:48.007653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:48.016549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:48.018006 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:48.019123 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-531f4dd4-ad10-4946-87f3-02afb95200a3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.202588 Sep 15 00:53:48.019727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 538/1091] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:47 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:53:48.471213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-0416ce01-c3de-4e0e-ab95-4fb1e598a855 req-34cd7d29-d57f-4cf7-bc86-3728a02736dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adedf981-66a2-455b-8192-1852eea1312b", "tag": "cc2b33ab-216b-4ead-83c4-eee6a3d2ec41"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:48.480982 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0416ce01-c3de-4e0e-ab95-4fb1e598a855 req-34cd7d29-d57f-4cf7-bc86-3728a02736dd service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:48.481467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0416ce01-c3de-4e0e-ab95-4fb1e598a855 req-34cd7d29-d57f-4cf7-bc86-3728a02736dd service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:48.481904 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0416ce01-c3de-4e0e-ab95-4fb1e598a855 req-34cd7d29-d57f-4cf7-bc86-3728a02736dd service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:48.492647 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-0416ce01-c3de-4e0e-ab95-4fb1e598a855 req-34cd7d29-d57f-4cf7-bc86-3728a02736dd service nova] Creating event network-changed:cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 for instance adedf981-66a2-455b-8192-1852eea1312b on hv-cinder-85752 Sep 15 00:53:48.498035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-0416ce01-c3de-4e0e-ab95-4fb1e598a855 req-34cd7d29-d57f-4cf7-bc86-3728a02736dd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030565 Sep 15 00:53:48.498598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 554/1092] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:48.585582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:48.586199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:48.588054 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=18 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:48.593799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:48.594279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:48.594715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:48.595405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:48.595885 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:48.596309 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:48.724628 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:48.732640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0e5d9035-99bf-4b49-b70b-ff3e2b4bc728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.151010 Sep 15 00:53:48.733204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 539/1093] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:48 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:48.851384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:48.855061 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:48.861347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:48.862133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:48.862575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:48.863381 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:48.863915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:48.864401 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:48.893822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a86be25c-8741-48ee-badb-420bf626f6c5 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047252 Sep 15 00:53:48.894640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 555/1094] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:53:48 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:49.044140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:49.044914 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:49.050813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:49.051291 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:49.051760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:49.052448 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:49.052908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:49.053328 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:49.181117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:49.189310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:49.190753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:49.191898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7f0e3e9f-0cb2-4683-a9c3-900c8f497fad tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1406 microversion: 2.20 time: 0.152304 Sep 15 00:53:49.192466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 540/1095] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:49 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:49.756016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:49.756630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:49.763106 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:49.763617 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:49.764052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:49.764740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:49.765196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:49.765618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:49.894672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:49.902415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b899faae-6db7-4360-85c8-e09e4266e47d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.150232 Sep 15 00:53:49.902980 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 556/1096] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:49 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:49.905365 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:49.907692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:49.914018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:49.914510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:49.914951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:49.915677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:49.916143 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:49.916574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:49.946460 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-08e05ee8-7e15-4dde-a5d3-fee261c97d58 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Sep 15 00:53:49.947344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 541/1097] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:53:49 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:50.217124 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:50.217665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:50.223623 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:50.224122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:50.224566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:50.225276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:50.225741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:50.226175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:50.380600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:50.388639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:50.390076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:50.391231 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6c61d4dc-8c0a-479c-b5b5-58a57d868c4c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1598 microversion: 2.20 time: 0.178546 Sep 15 00:53:50.391829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 557/1098] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:53:50 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1598 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:53:50.415595 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:50.416093 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:50.423602 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:50.424088 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:50.424526 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:50.425225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:50.425680 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:50.426110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:50.500936 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-24e6697c-5242-40ad-9ab3-36d5ed6da5dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089158 Sep 15 00:53:50.501561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 542/1099] 10.222.0.15 () {60 vars in 1316 bytes} [Thu Sep 15 00:53:50 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:53:50.925562 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:50.926163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:50.933532 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:50.934028 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:50.934465 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:50.937016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:50.937567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:50.938007 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:50.959281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:50.962342 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:50.968856 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:50.969412 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:50.969919 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:50.970863 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:50.971427 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:50.971982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:51.003658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-015d9f01-57cc-4cdc-8c31-16dcbe930b81 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048806 Sep 15 00:53:51.004874 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 543/1100] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:53:50 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 00:53:51.018289 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:51.019065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:51.025455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:51.026777 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:51.027458 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:51.028587 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:51.029255 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:51.029939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:51.120661 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] HTTP exception thrown: Instance adedf981-66a2-455b-8192-1852eea1312b is not attached to volume 07ac5281-d3af-4cbf-b468-35ebc5f694d8 Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Request method failure captured: Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: DELETE /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments/07ac5281-d3af-4cbf-b468-35ebc5f694d8 HTTP/1.1 Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInaoetloJ2gxyThWvD-I29S6fWK-jJGbeJLQsTnA8uuV2muidzj7kfBMbHYUR0aZyK9I18s2tBzNfBWRvH-NsRRVm0vnYH1cTsG47eeusjX177Ug35sQ-0401tX1XzhGntrZU7e51nJFyxEMeUF9JYEvpzqPceuYNeQBgLrNZGikPkA Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 762beb87caad4aa691528a7d9de01086 Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-TestMinimumBasicScenario-2135852114 Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:53:51.123604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/762beb87caad4aa691528a7d9de01086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_762beb87caad4aa691528a7d9de01086", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/762beb87caad4aa691528a7d9de01086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/762beb87caad4aa691528a7d9de01086"}]}] Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-TestMinimumBasicScenario-2135852114 Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 762beb87caad4aa691528a7d9de01086 Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2135852114 Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-TestMinimumBasicScenario-2135852114-project Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 5d47be4ab52f4034ac09fbf043990709 Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-TestMinimumBasicScenario-2135852114-project Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:53:51.125466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance adedf981-66a2-455b-8192-1852eea1312b is not attached to volume 07ac5281-d3af-4cbf-b468-35ebc5f694d8 Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'server_id': 'adedf981-66a2-455b-8192-1852eea1312b', 'id': '07ac5281-d3af-4cbf-b468-35ebc5f694d8'} Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 07ac5281-d3af-4cbf-b468-35ebc5f694d8. Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:53:51.126316 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adedf981-66a2-455b-8192-1852eea1312b is not attached to volume 07ac5281-d3af-4cbf-b468-35ebc5f694d8 Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adedf981-66a2-455b-8192-1852eea1312b is not attached to volume 07ac5281-d3af-4cbf-b468-35ebc5f694d8 Sep 15 00:53:51.127593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:53:51.129709 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Returning 404 to user: Instance adedf981-66a2-455b-8192-1852eea1312b is not attached to volume 07ac5281-d3af-4cbf-b468-35ebc5f694d8 {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:53:51.132809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9b09b62d-20d8-4668-97b6-1c22ae784ca7 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "DELETE /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments/07ac5281-d3af-4cbf-b468-35ebc5f694d8" status: 404 len: 154 microversion: 2.1 time: 0.119063 Sep 15 00:53:51.133621 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 544/1101] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:53:51 2022] DELETE /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b/os-volume_attachments/07ac5281-d3af-4cbf-b468-35ebc5f694d8 => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:53:51.269489 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:51.278879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-709f6adc-7b98-401e-9406-8cbcbea8a08f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.357324 Sep 15 00:53:51.295775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 558/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:50 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:51.558178 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-224ee30b-fdc4-4689-a84e-e06a80e66aa5 req-41ea981a-bc1e-4b27-8a0e-9feaf61fee74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c270acf-24d9-4d2e-bf97-2f487bd44a96", "tag": "9e2fa835-2b12-4126-9efe-5387a46e4c0c"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:51.572125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-224ee30b-fdc4-4689-a84e-e06a80e66aa5 req-41ea981a-bc1e-4b27-8a0e-9feaf61fee74 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:51.572714 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-224ee30b-fdc4-4689-a84e-e06a80e66aa5 req-41ea981a-bc1e-4b27-8a0e-9feaf61fee74 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:51.573391 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-224ee30b-fdc4-4689-a84e-e06a80e66aa5 req-41ea981a-bc1e-4b27-8a0e-9feaf61fee74 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:51.585593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-224ee30b-fdc4-4689-a84e-e06a80e66aa5 req-41ea981a-bc1e-4b27-8a0e-9feaf61fee74 service nova] Creating event network-changed:9e2fa835-2b12-4126-9efe-5387a46e4c0c for instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 on hv-cinder-85752 Sep 15 00:53:51.591751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-224ee30b-fdc4-4689-a84e-e06a80e66aa5 req-41ea981a-bc1e-4b27-8a0e-9feaf61fee74 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038992 Sep 15 00:53:51.592347 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 545/1103] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:52.318818 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:52.320515 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:52.330713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:52.337755 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:52.338195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:52.339591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:52.340050 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:52.340646 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:52.356871 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:52.357465 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:52.364305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:52.365159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:52.365600 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:52.366484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:52.367108 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:52.367728 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:52.398637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:53:52.506025 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c6728065-d8f0-4882-a0e9-267ac8436faf tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "DELETE /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 204 len: 0 microversion: 2.1 time: 0.153206 Sep 15 00:53:52.509633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 546/1104] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:53:52 2022] DELETE /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:53:52.517161 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:52.519659 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:52.520336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:52.526001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c4556830-9fde-4028-8467-b25160d620d4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.212691 Sep 15 00:53:52.527282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:52.534928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 559/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:52 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:52.535117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:52.535117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:52.535117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:52.535117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:52.535417 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:52.535417 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:52.677361 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:52.685844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6c17c89d-1e08-457c-bf26-6117d30ff090 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1553 microversion: 2.1 time: 0.170932 Sep 15 00:53:52.686431 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 547/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:52 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:53.550358 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:53.551012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:53.558173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:53.558665 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:53.559105 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:53.559846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:53.560310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:53.560742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:53.625419 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-68b07b2c-e1d0-4852-ae4c-579198de0d99 req-bee89691-2312-4abd-9da2-09dc8d9cdeec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c770ee1-1cc8-4af3-bb2c-ab3753156e37", "name": "network-vif-plugged", "status": "completed", "tag": "d1b21f4d-7863-4a9c-ac7d-ae028778c2c8"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:53.636520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-68b07b2c-e1d0-4852-ae4c-579198de0d99 req-bee89691-2312-4abd-9da2-09dc8d9cdeec service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:53.637003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-68b07b2c-e1d0-4852-ae4c-579198de0d99 req-bee89691-2312-4abd-9da2-09dc8d9cdeec service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:53.637450 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-68b07b2c-e1d0-4852-ae4c-579198de0d99 req-bee89691-2312-4abd-9da2-09dc8d9cdeec service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:53.651973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-68b07b2c-e1d0-4852-ae4c-579198de0d99 req-bee89691-2312-4abd-9da2-09dc8d9cdeec service nova] Creating event network-vif-plugged:d1b21f4d-7863-4a9c-ac7d-ae028778c2c8 for instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 on hv-cinder-85752 Sep 15 00:53:53.659160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-68b07b2c-e1d0-4852-ae4c-579198de0d99 req-bee89691-2312-4abd-9da2-09dc8d9cdeec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037709 Sep 15 00:53:53.659984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 548/1107] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:53:53.706391 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:53.709800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:53.710508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:53.715024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ba79450e-3e99-49d8-8eec-2b77d3dea130 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.168558 Sep 15 00:53:53.715649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 560/1108] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:53 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:53.718942 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:53.719433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:53.719910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:53.720641 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:53.721190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:53.721613 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:53.848997 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:53.856727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-39a4e6f3-a2c3-41c1-8fbb-fad78d057052 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1553 microversion: 2.1 time: 0.151163 Sep 15 00:53:53.857292 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 549/1109] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:53 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:54.738167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:54.738792 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:54.745217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:54.745705 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:54.746144 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:54.746849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:54.747307 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:54.747766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:54.874872 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:54.879151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:54.879889 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:54.882502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-000185b9-ae61-4b8b-889b-1e63450f278a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.148263 Sep 15 00:53:54.883082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 561/1110] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:54 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:54.887000 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:54.887564 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:54.887929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:54.888630 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:54.889087 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:54.889692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:55.018354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:55.026151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d1d01063-b6ab-4842-9d13-b03b1e450a7b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1553 microversion: 2.1 time: 0.150842 Sep 15 00:53:55.026717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 550/1111] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:54 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:55.906318 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:55.906936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:55.909418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:55.914699 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:55.915191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:55.915666 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:55.916374 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:55.917448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:55.917880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:56.049173 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:56.050035 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:56.056610 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:56.057134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:56.057533 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:56.058267 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:56.058785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:56.059298 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:56.059769 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:56.068361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f8f51fe4-dddc-494e-8a73-cd3dab640877 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1265 microversion: 2.1 time: 0.165886 Sep 15 00:53:56.069143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 562/1112] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:55 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:56.145385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:56.154231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-bd91be59-18f8-4a5e-8c3d-7ed61c2880aa tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1511 microversion: 2.1 time: 0.108956 Sep 15 00:53:56.154826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 551/1113] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:56 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1511 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:56.203860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f5b6b12f-a647-44c3-bcfe-02e3d2878af4 req-393a8d4e-beec-4614-962d-65c17c20efd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adedf981-66a2-455b-8192-1852eea1312b", "name": "network-vif-deleted", "tag": "cc2b33ab-216b-4ead-83c4-eee6a3d2ec41"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:56.212939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f5b6b12f-a647-44c3-bcfe-02e3d2878af4 req-393a8d4e-beec-4614-962d-65c17c20efd9 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:56.214039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f5b6b12f-a647-44c3-bcfe-02e3d2878af4 req-393a8d4e-beec-4614-962d-65c17c20efd9 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:56.214473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f5b6b12f-a647-44c3-bcfe-02e3d2878af4 req-393a8d4e-beec-4614-962d-65c17c20efd9 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:56.224954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f5b6b12f-a647-44c3-bcfe-02e3d2878af4 req-393a8d4e-beec-4614-962d-65c17c20efd9 service nova] Creating event network-vif-deleted:cc2b33ab-216b-4ead-83c4-eee6a3d2ec41 for instance adedf981-66a2-455b-8192-1852eea1312b on hv-cinder-85752 Sep 15 00:53:56.230372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f5b6b12f-a647-44c3-bcfe-02e3d2878af4 req-393a8d4e-beec-4614-962d-65c17c20efd9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030135 Sep 15 00:53:56.231122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 563/1114] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:53:57.092639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:57.093348 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:57.099333 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:57.099850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:57.100292 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:57.100995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:57.101453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:57.101881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:57.179599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:57.180090 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:57.186393 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:57.187076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:57.187610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:57.188260 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:57.188722 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:57.189191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:57.226167 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:57.226658 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:57.227092 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:57.227561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lazy-loading 'fault' on Instance uuid adedf981-66a2-455b-8192-1852eea1312b {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:53:57.235349 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:57.243216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a582789f-9a35-4e78-88cf-32d9014610de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1450 microversion: 2.1 time: 0.155022 Sep 15 00:53:57.243830 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 552/1115] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:57 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:53:57.265386 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:57.266027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:57.269473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d47be4ab52f4034ac09fbf043990709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762beb87caad4aa691528a7d9de01086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:57.272165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:57.272650 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:57.273083 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:57.273782 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:57.274233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:57.274654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:57.277642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5820f2c5-b920-4881-ad5f-07f6a5dfbd2b tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 200 len: 1348 microversion: 2.1 time: 0.103233 Sep 15 00:53:57.278210 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 564/1116] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:57 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:57.401051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:53:57.408629 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0795ff6c-9cf7-4dcf-98c3-fd1e9573628f tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1450 microversion: 2.1 time: 0.147069 Sep 15 00:53:57.409190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 553/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:57 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:53:58.299807 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:58.300402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] [instance: adedf981-66a2-455b-8192-1852eea1312b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:53:58.306736 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:58.307257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:58.307727 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:58.308428 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:58.308881 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:58.309305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:58.323110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] HTTP exception thrown: Instance adedf981-66a2-455b-8192-1852eea1312b could not be found. Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Request method failure captured: Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b HTTP/1.1 Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInaoetloJ2gxyThWvD-I29S6fWK-jJGbeJLQsTnA8uuV2muidzj7kfBMbHYUR0aZyK9I18s2tBzNfBWRvH-NsRRVm0vnYH1cTsG47eeusjX177Ug35sQ-0401tX1XzhGntrZU7e51nJFyxEMeUF9JYEvpzqPceuYNeQBgLrNZGikPkA Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 762beb87caad4aa691528a7d9de01086 Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestMinimumBasicScenario-2135852114 Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:53:58.324797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/762beb87caad4aa691528a7d9de01086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_762beb87caad4aa691528a7d9de01086", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/762beb87caad4aa691528a7d9de01086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/762beb87caad4aa691528a7d9de01086"}]}] Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestMinimumBasicScenario-2135852114 Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 762beb87caad4aa691528a7d9de01086 Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2135852114 Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-TestMinimumBasicScenario-2135852114-project Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 5d47be4ab52f4034ac09fbf043990709 Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestMinimumBasicScenario-2135852114-project Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance adedf981-66a2-455b-8192-1852eea1312b could not be found. Sep 15 00:53:58.326285 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'adedf981-66a2-455b-8192-1852eea1312b'} Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adedf981-66a2-455b-8192-1852eea1312b could not be found. Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:53:58.327059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adedf981-66a2-455b-8192-1852eea1312b could not be found. Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adedf981-66a2-455b-8192-1852eea1312b could not be found. Sep 15 00:53:58.328435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:53:58.329577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Returning 404 to user: Instance adedf981-66a2-455b-8192-1852eea1312b could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:53:58.329577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3a1d059b-5bc3-4a9f-b882-1afcf0d98968 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b" status: 404 len: 111 microversion: 2.1 time: 0.030294 Sep 15 00:53:58.329577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 565/1118] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:53:58 2022] GET /compute/v2.1/servers/adedf981-66a2-455b-8192-1852eea1312b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:53:58.334778 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b0f5436f-25a9-4f52-8aa8-ade0efeafa60 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] Calling method '.version_select at 0x7f2f1d0d0820>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:53:58.354620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b0f5436f-25a9-4f52-8aa8-ade0efeafa60 tempest-TestMinimumBasicScenario-2135852114 tempest-TestMinimumBasicScenario-2135852114-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-572765165" status: 202 len: 0 microversion: 2.1 time: 0.023546 Sep 15 00:53:58.355194 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 554/1119] 10.222.0.15 () {58 vars in 1269 bytes} [Thu Sep 15 00:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-572765165 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:53:59.017950 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f00604c1-02be-45fb-b266-508d723b827e req-110755e1-5b24-4947-87c4-304a330f30f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c770ee1-1cc8-4af3-bb2c-ab3753156e37", "tag": "d1b21f4d-7863-4a9c-ac7d-ae028778c2c8"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:53:59.028276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f00604c1-02be-45fb-b266-508d723b827e req-110755e1-5b24-4947-87c4-304a330f30f5 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:53:59.029218 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f00604c1-02be-45fb-b266-508d723b827e req-110755e1-5b24-4947-87c4-304a330f30f5 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:53:59.029708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f00604c1-02be-45fb-b266-508d723b827e req-110755e1-5b24-4947-87c4-304a330f30f5 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:53:59.042524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f00604c1-02be-45fb-b266-508d723b827e req-110755e1-5b24-4947-87c4-304a330f30f5 service nova] Creating event network-changed:d1b21f4d-7863-4a9c-ac7d-ae028778c2c8 for instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 on hv-cinder-85752 Sep 15 00:53:59.047754 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f00604c1-02be-45fb-b266-508d723b827e req-110755e1-5b24-4947-87c4-304a330f30f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033500 Sep 15 00:53:59.048648 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 566/1120] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:54:54.810311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:54:54.810880 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:54:54.813085 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=36 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:54.813933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:54.820100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:54:54.820585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:54:54.821025 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:54:54.821727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:54:54.822187 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:54:54.822614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:54:54.848077 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c266dd12-5aa8-4411-8685-ed6af35b1fd8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/ips" status: 200 len: 149 microversion: 2.1 time: 0.041878 Sep 15 00:54:54.848640 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 555/1121] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:54:54 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:54:56.212190 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=11 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:56.212931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=74 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:56.218206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:54:56.220609 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:54:56.227588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:54:56.228045 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:54:56.228476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:54:56.229163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:54:56.229615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:54:56.230038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:54:56.720176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-52ffdd61-c22b-407b-93e9-820faee689aa tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509796 Sep 15 00:54:56.720778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 567/1122] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:54:56 2022] POST /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:54:57.134332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:54:57.134911 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:54:57.142435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:54:57.143052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:54:57.143549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:54:57.144253 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:54:57.144717 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:54:57.145156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:54:57.168453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-89059c2f-e506-4061-ac01-038595a30fda tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/ips" status: 200 len: 145 microversion: 2.1 time: 0.169705 Sep 15 00:54:57.168952 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 556/1123] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:54:56 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/ips => generated 145 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:54:58.506915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "200437c2-9366-4766-bca9-f27256ef3bf1"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:54:58.509377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:54:58.515443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:54:58.515966 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:54:58.516403 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:54:58.517099 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:54:58.517556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:54:58.517992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:54:58.774346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-42847c4c-fb11-46f1-95ce-0230cf56fa81 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272061 Sep 15 00:54:58.774956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 568/1124] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:54:58 2022] POST /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:04.250464 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-611d0c6f-c409-4796-b845-bdaab25edefe tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: .version_select at 0x7f2f1d1c4280>, body: {"keypair": {"name": "tempest-keypair-458278090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxOgrvkXVcKjNcefrwhmd+rJeUnGbSOkcvAQlnIBTO69zLdJC4ykHt9Qunn9apF6wgYkP/MZ38TNaCmak4JUz0EPpfXHMtMuSM/EIUB76zjruqU+hY7/JdJDTrA55ZMqw=="}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:04.266887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-611d0c6f-c409-4796-b845-bdaab25edefe tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:55:04.270696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-611d0c6f-c409-4796-b845-bdaab25edefe tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for user 778fc9ee164e46a9b874dd0e20d38392 and project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:55:04.291937 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-611d0c6f-c409-4796-b845-bdaab25edefe tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046166 Sep 15 00:55:04.292544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 557/1125] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:55:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:05.531503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-33208605", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48f46f03-9920-4d15-b1d4-ea751486aaae"}], "security_groups": [{"name": "tempest-securitygroup--1381951820"}], "key_name": "tempest-keypair-458278090", "user_data": "}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:05.637462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] validate_networks() for [('48f46f03-9920-4d15-b1d4-ea751486aaae', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:55:06.016290 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:55:06.016742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:55:06.017214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:55:06.017621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:55:06.018029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:55:06.026438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:06.026917 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:06.027352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:06.028119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:06.028575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:06.028997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:06.046015 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:55:06.050436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for user 778fc9ee164e46a9b874dd0e20d38392 and project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:55:06.061017 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:55:06.063347 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:55:06.113064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-92f634df-d8ad-4258-8557-7027d136035b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586643 Sep 15 00:55:06.113712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 569/1126] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:55:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:55:06.125627 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b66e27b2-e274-4287-9008-af3975ae43ce tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:06.126237 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b66e27b2-e274-4287-9008-af3975ae43ce tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:06.292560 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b66e27b2-e274-4287-9008-af3975ae43ce tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:06.299601 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b66e27b2-e274-4287-9008-af3975ae43ce tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1239 microversion: 2.1 time: 0.178657 Sep 15 00:55:06.300173 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 558/1127] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:06 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1239 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:07.322741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:07.323364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:07.329770 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:07.330264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:07.330709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:07.331408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:07.331918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:07.332349 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:07.394998 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:07.402467 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7eda89cf-4d52-41be-8fb6-1134e3d6729f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1291 microversion: 2.1 time: 0.084243 Sep 15 00:55:07.403040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 570/1128] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:07 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1291 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:08.425497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:08.426432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:08.429211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=8 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:08.434818 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:08.435315 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:08.435879 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:08.436588 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:08.437044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:08.437975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:08.909183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:08.916895 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2eeac70a-935e-4fdf-b444-953fed841567 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.495427 Sep 15 00:55:08.917788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 559/1129] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:08 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:09.287669 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-2735d761-7674-46b3-a716-0380c3e10190 req-78af60ef-23b9-4b56-b89a-5592d83b87a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919d6f99-161e-4c7f-b7e8-2183095d5e1f", "tag": "d96819c5-d122-476e-b592-f224863bf88c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:09.298789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2735d761-7674-46b3-a716-0380c3e10190 req-78af60ef-23b9-4b56-b89a-5592d83b87a5 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:09.299583 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2735d761-7674-46b3-a716-0380c3e10190 req-78af60ef-23b9-4b56-b89a-5592d83b87a5 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:09.300247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2735d761-7674-46b3-a716-0380c3e10190 req-78af60ef-23b9-4b56-b89a-5592d83b87a5 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:09.314049 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-2735d761-7674-46b3-a716-0380c3e10190 req-78af60ef-23b9-4b56-b89a-5592d83b87a5 service nova] Creating event network-changed:d96819c5-d122-476e-b592-f224863bf88c for instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f on hv-cinder-85752 Sep 15 00:55:09.318833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-2735d761-7674-46b3-a716-0380c3e10190 req-78af60ef-23b9-4b56-b89a-5592d83b87a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035037 Sep 15 00:55:09.319448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 571/1130] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:09.939942 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:09.940487 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:09.947596 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:09.948307 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:09.949096 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:09.949825 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:09.950282 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:09.950700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:10.115133 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:10.122721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7d22f9d9-4b2a-416d-a369-2086c2ef9219 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.187670 Sep 15 00:55:10.123293 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 560/1131] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:09 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:10.551887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:10.554124 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:10.560496 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:10.561055 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:10.561521 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:10.562744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:10.563213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:10.563680 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:10.593785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-164b839a-f3b1-459e-a843-247a0f79d288 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Sep 15 00:55:10.594348 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 572/1132] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:55:10 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:10.605156 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:10.605617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:10.611743 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:10.612227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:10.612659 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:10.613522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:10.613985 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:10.614410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:10.644653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2ac2d235-0a6c-4381-aaaf-ea825454200b tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/200437c2-9366-4766-bca9-f27256ef3bf1" status: 200 len: 194 microversion: 2.1 time: 0.043423 Sep 15 00:55:10.647700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 561/1133] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 15 00:55:10 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/200437c2-9366-4766-bca9-f27256ef3bf1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:11.145377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:11.145914 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:11.151822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:11.152308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:11.152739 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:11.153428 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:11.153884 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:11.154306 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:11.288575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:11.297473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-49faaa9e-10c1-4ee6-b603-bb27a1d0ada2 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.155401 Sep 15 00:55:11.298040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 573/1134] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:11 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:11.990407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b857019-9edb-432f-b166-8c578eddc3e2"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:11.992848 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:11.999672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:12.000659 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:12.001093 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:12.001794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:12.002250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:12.002676 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:12.320367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:12.320901 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:12.327274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:12.327798 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:12.328240 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:12.328936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:12.329663 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:12.330087 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:12.458550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:12.466093 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-669045ec-3b2c-4e44-80ee-054740e86571 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.149725 Sep 15 00:55:12.466652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 574/1135] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:12 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:55:13.423913 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-07425177-2471-4143-bf54-1bdcd92df8e0 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "POST /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.437322 Sep 15 00:55:13.424535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 562/1136] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:55:11 2022] POST /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments => generated 194 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:13.487408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:13.488611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:13.495083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:13.495600 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:13.496042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:13.496736 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:13.497192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:13.497615 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:13.629108 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:13.636691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b5c2a4d2-e716-4a88-9fd9-f1fc165751eb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.153121 Sep 15 00:55:13.637274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 575/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:13 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:14.659993 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:14.660696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:14.667334 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:14.667850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:14.668284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:14.668975 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:14.669429 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:14.669867 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:14.805220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:14.813386 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4f1b5e2c-d3ca-456a-a31f-bdab3cf11a44 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.157689 Sep 15 00:55:14.813948 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 563/1138] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:14 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:15.836163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:15.836815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:15.843637 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:15.844129 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:15.844572 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:15.845281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:15.845742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:15.846208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:15.982073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:15.990744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5f3b79b4-eb89-4549-902e-87f150f49c1b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.158486 Sep 15 00:55:15.991327 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 576/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:15 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:17.014537 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:17.015152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:17.018101 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=6 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:17.023514 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:17.023988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:17.024428 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:17.025124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:17.025579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:17.026005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:17.153845 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:17.161445 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-42366d42-a2f6-42f6-9d4f-e30778eb7472 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.150834 Sep 15 00:55:17.162013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 564/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:17 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:17.937412 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-55f7a236-44d4-46f3-835b-3f1b525ad83f req-c181dddb-7840-43c3-bd49-ed6e90b76a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919d6f99-161e-4c7f-b7e8-2183095d5e1f", "name": "network-vif-plugged", "status": "completed", "tag": "d96819c5-d122-476e-b592-f224863bf88c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:17.942332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:17.942990 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:17.949928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-55f7a236-44d4-46f3-835b-3f1b525ad83f req-c181dddb-7840-43c3-bd49-ed6e90b76a46 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:17.950403 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-55f7a236-44d4-46f3-835b-3f1b525ad83f req-c181dddb-7840-43c3-bd49-ed6e90b76a46 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:17.950831 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-55f7a236-44d4-46f3-835b-3f1b525ad83f req-c181dddb-7840-43c3-bd49-ed6e90b76a46 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:17.961954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-55f7a236-44d4-46f3-835b-3f1b525ad83f req-c181dddb-7840-43c3-bd49-ed6e90b76a46 service nova] Creating event network-vif-plugged:d96819c5-d122-476e-b592-f224863bf88c for instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f on hv-cinder-85752 Sep 15 00:55:17.966746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-55f7a236-44d4-46f3-835b-3f1b525ad83f req-c181dddb-7840-43c3-bd49-ed6e90b76a46 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033052 Sep 15 00:55:17.967322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 577/1141] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:18.183711 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:18.184104 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:18.190306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:18.190794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:18.191239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:18.191970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:18.192430 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:18.192858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:18.327146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:18.335678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6b3a6967-7024-4625-8136-e00e92eb37c1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.156307 Sep 15 00:55:18.336243 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 565/1142] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:18 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:19.360487 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:19.361195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:19.367518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:19.367996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:19.368431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:19.369119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:19.369569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:19.369996 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:19.497863 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:19.505829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e250eecb-ebf4-40a5-bd9a-fa52dbbb8eb1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1365 microversion: 2.1 time: 0.150881 Sep 15 00:55:19.506400 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 578/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:19 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:20.530234 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:20.530988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:20.539618 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:20.540244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:20.540752 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:20.541660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:20.542205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:20.542678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:20.679946 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:20.687649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e3d32765-bb6d-4c58-ac89-2ec375f5cf73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1554 microversion: 2.1 time: 0.163337 Sep 15 00:55:20.688220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 566/1144] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:20 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:20.710121 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:20.710624 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:20.717016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:20.717500 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:20.717939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:20.718636 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:20.719123 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:20.719584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:20.794652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-62094c43-dedc-4bac-8292-6b71864a90e9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088484 Sep 15 00:55:20.795256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 579/1145] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 00:55:20 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:21.662073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:21.662635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:21.669388 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:21.669881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:21.670319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:21.671026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:21.671497 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:21.672002 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:21.701051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ad4cf49d-6649-431b-bb66-88cef8bcd8e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/ips" status: 200 len: 152 microversion: 2.20 time: 0.042912 Sep 15 00:55:21.701645 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 567/1146] 10.222.0.15 () {60 vars in 1289 bytes} [Thu Sep 15 00:55:21 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:55:21.795664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-0710ee5a-b6cd-4c07-b8b8-21d9a66c4e4a req-4ebfb30b-a7f6-45c9-b59c-ae53d9f86cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919d6f99-161e-4c7f-b7e8-2183095d5e1f", "tag": "d96819c5-d122-476e-b592-f224863bf88c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:21.807635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0710ee5a-b6cd-4c07-b8b8-21d9a66c4e4a req-4ebfb30b-a7f6-45c9-b59c-ae53d9f86cee service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:21.808123 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0710ee5a-b6cd-4c07-b8b8-21d9a66c4e4a req-4ebfb30b-a7f6-45c9-b59c-ae53d9f86cee service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:21.808568 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-0710ee5a-b6cd-4c07-b8b8-21d9a66c4e4a req-4ebfb30b-a7f6-45c9-b59c-ae53d9f86cee service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:21.820575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-0710ee5a-b6cd-4c07-b8b8-21d9a66c4e4a req-4ebfb30b-a7f6-45c9-b59c-ae53d9f86cee service nova] Creating event network-changed:d96819c5-d122-476e-b592-f224863bf88c for instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f on hv-cinder-85752 Sep 15 00:55:21.825924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-0710ee5a-b6cd-4c07-b8b8-21d9a66c4e4a req-4ebfb30b-a7f6-45c9-b59c-ae53d9f86cee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099902 Sep 15 00:55:21.826673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 580/1147] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:22.074684 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:22.077035 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:22.083550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:22.084040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:22.084539 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:22.085239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:22.085692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:22.086238 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:22.118423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a8fcdb99-74db-40c2-8090-66ac8b083c83 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047803 Sep 15 00:55:22.119083 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 568/1148] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:55:22 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:22.259374 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:22.260352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:22.272163 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:22.273040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:22.273860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:22.274765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:22.275454 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:22.276140 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:22.312902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0c6a3ff2-97cf-47e5-8a0c-2cf1f497193d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/200437c2-9366-4766-bca9-f27256ef3bf1" status: 200 len: 194 microversion: 2.1 time: 0.057805 Sep 15 00:55:22.315007 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 581/1149] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 15 00:55:22 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/200437c2-9366-4766-bca9-f27256ef3bf1 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:22.325484 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:22.326246 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:22.332758 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:22.333812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:22.335548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:22.336448 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:22.337596 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:22.338192 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:22.436949 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lazy-loading 'services' on Instance uuid c186a1d3-16da-4f22-81e3-0e80c8fbd1fc {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:55:22.529431 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-5964a99d-4ad0-43db-a05d-95885d9b156f tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/200437c2-9366-4766-bca9-f27256ef3bf1" status: 202 len: 0 microversion: 2.1 time: 0.207134 Sep 15 00:55:22.539688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 569/1150] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:55:22 2022] DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/200437c2-9366-4766-bca9-f27256ef3bf1 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:55:23.346237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:23.346810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:23.355932 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.356426 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.356869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.357589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.358052 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.358489 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.384824 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:55:23.418364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:23.461936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b454b67c-d460-43de-8a9d-504b82b55c23 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 204 len: 0 microversion: 2.1 time: 0.119504 Sep 15 00:55:23.462532 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 582/1151] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:55:23 2022] DELETE /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:55:23.471829 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:23.472565 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:23.478705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.479180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.479669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.480336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.480788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.481219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.551773 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:23.552806 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:23.567424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.568120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.568800 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.569721 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.570395 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.571036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.598475 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lazy-loading 'flavor' on Instance uuid 4c270acf-24d9-4d2e-bf97-2f487bd44a96 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:55:23.637971 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:23.647821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-baa07e26-54f2-4a53-883e-ee54923e09f8 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.180728 Sep 15 00:55:23.649332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 570/1152] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:23 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:23.820070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9062a924-ae33-4f86-810a-c21a97f31a75 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/action" status: 202 len: 0 microversion: 2.20 time: 0.273704 Sep 15 00:55:23.820678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 583/1153] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 15 00:55:23 2022] POST /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 00:55:23.828950 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:23.829624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:23.836463 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.837208 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.837961 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.838908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.839599 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.840279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.842352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-45d934b2-8a74-444e-8470-23025cc7244b req-968a5ad8-7e08-4b04-89c9-4d21e10a2f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58c94a4-c708-4b2f-b8b1-fa336f60aa4b", "tag": "f8e5a3ed-229c-4186-8197-286fa9b6a050"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:23.854100 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-45d934b2-8a74-444e-8470-23025cc7244b req-968a5ad8-7e08-4b04-89c9-4d21e10a2f3a service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:23.855195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-45d934b2-8a74-444e-8470-23025cc7244b req-968a5ad8-7e08-4b04-89c9-4d21e10a2f3a service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:23.855927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-45d934b2-8a74-444e-8470-23025cc7244b req-968a5ad8-7e08-4b04-89c9-4d21e10a2f3a service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:23.869537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-45d934b2-8a74-444e-8470-23025cc7244b req-968a5ad8-7e08-4b04-89c9-4d21e10a2f3a service nova] Creating event network-changed:f8e5a3ed-229c-4186-8197-286fa9b6a050 for instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b on hv-cinder-85752 Sep 15 00:55:23.874614 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-45d934b2-8a74-444e-8470-23025cc7244b req-968a5ad8-7e08-4b04-89c9-4d21e10a2f3a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037244 Sep 15 00:55:23.875669 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 584/1154] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:55:23.972942 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:23.981160 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:23.982598 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:23.983815 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-78d1560c-ce94-42f3-80d2-3ba9f244e991 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.158795 Sep 15 00:55:23.984371 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 571/1155] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:23 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:24.673582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:24.674282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:24.680451 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:24.680973 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:24.681408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:24.682109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:24.682605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:24.683038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:24.823856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:24.832688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-adaa3928-945c-4445-85d1-9626bd045b06 tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1567 microversion: 2.1 time: 0.163769 Sep 15 00:55:24.833468 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 585/1156] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:24 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:25.010263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:25.010826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:25.013308 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:25.019374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:25.019891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:25.020331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:25.021040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:25.021501 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:25.021933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:25.155132 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:25.164027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:25.165477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:25.166649 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-98321df6-3284-4097-bbf1-b924a3f8a69b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.160413 Sep 15 00:55:25.167207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 572/1157] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:25 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:25.799469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:25.800149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:25.806812 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:25.807438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:25.808021 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:25.808813 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:25.809379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:25.810109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:25.842081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8fb55c4e-263b-4bb8-9c05-6503140473c9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/0b857019-9edb-432f-b166-8c578eddc3e2" status: 200 len: 194 microversion: 2.1 time: 0.047087 Sep 15 00:55:25.842926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 586/1158] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 15 00:55:25 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/0b857019-9edb-432f-b166-8c578eddc3e2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:25.854449 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:25.855229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:25.855894 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:25.856625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:25.863910 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:25.864087 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:25.864407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:25.864775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:25.864904 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:25.865401 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:25.865543 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:25.866003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:25.866392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:25.866524 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:25.867197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:25.867757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:25.946127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:25.948132 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:25.952513 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lazy-loading 'services' on Instance uuid c186a1d3-16da-4f22-81e3-0e80c8fbd1fc {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:55:25.954524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-452a0456-54d2-4493-85ab-be0a30bf907a tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1499 microversion: 2.1 time: 0.102491 Sep 15 00:55:25.955198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 587/1159] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:25 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1499 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:55:26.026334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-bd451270-16a4-4a52-b836-7a0e713f614a req-925736fe-5ed4-4f33-b186-4a69f3d0a7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c94a4-c708-4b2f-b8b1-fa336f60aa4b", "name": "network-vif-deleted", "tag": "f8e5a3ed-229c-4186-8197-286fa9b6a050"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:26.035857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd451270-16a4-4a52-b836-7a0e713f614a req-925736fe-5ed4-4f33-b186-4a69f3d0a7d3 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:26.036342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd451270-16a4-4a52-b836-7a0e713f614a req-925736fe-5ed4-4f33-b186-4a69f3d0a7d3 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:26.036778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-bd451270-16a4-4a52-b836-7a0e713f614a req-925736fe-5ed4-4f33-b186-4a69f3d0a7d3 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:26.048903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-bd451270-16a4-4a52-b836-7a0e713f614a req-925736fe-5ed4-4f33-b186-4a69f3d0a7d3 service nova] Creating event network-vif-deleted:f8e5a3ed-229c-4186-8197-286fa9b6a050 for instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b on hv-cinder-85752 Sep 15 00:55:26.053844 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-bd451270-16a4-4a52-b836-7a0e713f614a req-925736fe-5ed4-4f33-b186-4a69f3d0a7d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Sep 15 00:55:26.054402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6c85e506-dd2d-42ce-bcc6-bfc6a4421f24 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/0b857019-9edb-432f-b166-8c578eddc3e2" status: 202 len: 0 microversion: 2.1 time: 0.203517 Sep 15 00:55:26.055338 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 573/1160] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:55:25 2022] DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments/0b857019-9edb-432f-b166-8c578eddc3e2 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:55:26.059121 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 588/1161] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:55:26.192405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:26.193131 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:26.199370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:26.199883 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:26.200343 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:26.201044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:26.201505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:26.201944 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:26.332878 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:26.341398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:26.342921 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:26.344142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3a004545-f82c-465c-bfa7-5a012e128013 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.155970 Sep 15 00:55:26.345311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 574/1162] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:26 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:26.978947 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:26.979704 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:26.982802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:26.987764 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:26.988245 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:26.988678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:26.989372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:26.989823 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:26.990256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:27.030143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:27.030625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:27.031112 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:27.031586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lazy-loading 'fault' on Instance uuid e58c94a4-c708-4b2f-b8b1-fa336f60aa4b {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:55:27.076264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f9c7fc74c448829608dab23d7023ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743501da05424df197d7af03d32eabb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:27.083869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ac5706bb-b820-443e-8cc5-4d26d4d81d9e tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 200 len: 1224 microversion: 2.1 time: 0.109493 Sep 15 00:55:27.084429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 589/1163] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:26 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:27.371134 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:27.371773 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:27.378765 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:27.379257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:27.379757 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:27.380472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:27.380930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:27.381355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:27.515061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:27.524052 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:27.525493 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:27.526660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e9fba5ee-45b0-42dc-8910-42dc29815c6b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.159538 Sep 15 00:55:27.527217 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 575/1164] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:27 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:28.107036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:28.107680 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] [instance: e58c94a4-c708-4b2f-b8b1-fa336f60aa4b] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:28.114575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.115066 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.115519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.116219 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.116668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.117093 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.131276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] HTTP exception thrown: Instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b could not be found. Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Request method failure captured: Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b HTTP/1.1 Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInZAJI0qTl8c7mpehtT9O2FLhBY8KjRpfLXG90RAqNZX-JoRZz9JsnOk-iR3QmNhC-S0i-lTtl1-yVz8Cus9SPNHougAoZzCk6tYJrrCZyxAkeWZ62_uVW3xaPv0rFUWDazAyey9EQ6Scsy_PmgkevtOyNn9TxtGEcis2rMcUnaHlhI Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 743501da05424df197d7af03d32eabb3 Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestShelveInstance-914820777 Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:55:28.132920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/743501da05424df197d7af03d32eabb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_743501da05424df197d7af03d32eabb3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/743501da05424df197d7af03d32eabb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/743501da05424df197d7af03d32eabb3"}]}] Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestShelveInstance-914820777 Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 743501da05424df197d7af03d32eabb3 Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestShelveInstance-914820777 Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-TestShelveInstance-914820777-project Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 65f9c7fc74c448829608dab23d7023ce Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestShelveInstance-914820777-project Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b could not be found. Sep 15 00:55:28.134606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'e58c94a4-c708-4b2f-b8b1-fa336f60aa4b'} Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b could not be found. Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:55:28.135598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b could not be found. Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b could not be found. Sep 15 00:55:28.137138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:28.138610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Returning 404 to user: Instance e58c94a4-c708-4b2f-b8b1-fa336f60aa4b could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:55:28.138610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d58abbe0-1ee7-498d-b059-088cf5e27fdf tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b" status: 404 len: 111 microversion: 2.1 time: 0.031111 Sep 15 00:55:28.138610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 590/1165] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:28 2022] GET /compute/v2.1/servers/e58c94a4-c708-4b2f-b8b1-fa336f60aa4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:55:28.297335 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f6f6b22d-0856-4be4-8c47-756f18e0d3ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] Calling method '.version_select at 0x7f2f1d0441f0>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:28.311750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:28.321019 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:28.327792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f6f6b22d-0856-4be4-8c47-756f18e0d3ed tempest-TestShelveInstance-914820777 tempest-TestShelveInstance-914820777-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-545593477" status: 202 len: 0 microversion: 2.1 time: 0.034342 Sep 15 00:55:28.330418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.330843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.331342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.332133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.332480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.333065 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.338258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 576/1166] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 15 00:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-545593477 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:55:28.370486 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7add1418-2743-4817-b3fc-7faed678d183 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066756 Sep 15 00:55:28.371039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 591/1167] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:55:28 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 00:55:28.492490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:28.494660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:28.501506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.501994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.502428 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.503125 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.504064 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.504491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.534046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-880c00d6-8ac4-415f-8443-cfd1df0a8c93 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046130 Sep 15 00:55:28.534624 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 577/1168] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:55:28 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 00:55:28.552767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:28.553531 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:28.560067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.560632 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.561158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.562010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.562534 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.563027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.599030 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:28.599574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:28.605490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.605987 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.606423 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.607153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.607614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.608047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.634346 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:55:28.718276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9ace9f5e-8dfe-44f7-a9c5-a5e576749815 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 204 len: 0 microversion: 2.1 time: 0.123235 Sep 15 00:55:28.718955 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 578/1169] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:55:28 2022] DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 00:55:28.728310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:28.729014 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:28.734921 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.735729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.736173 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.736877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:28.737335 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:28.737754 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:28.790341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:28.798879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:28.800361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:28.801614 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c2c99a6d-e876-4b30-af75-58f5b968dd54 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.253849 Sep 15 00:55:28.802201 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 592/1170] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:28 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:28.871219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:28.879821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e38cd3aa-b6ca-4da6-9e1d-9d50120fe196 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1672 microversion: 2.1 time: 0.155820 Sep 15 00:55:28.880403 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 579/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:28 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:55:29.828032 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:29.828634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:29.835794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:29.836287 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:29.836729 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:29.837436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:29.837893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:29.838342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:29.904335 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:29.904965 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:29.916266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:29.924190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:29.924973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:29.925792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:29.926628 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:29.927219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:30.003326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:30.023880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:30.026039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:30.027795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-29f0e8ca-709e-4008-9d1b-28f974ff7baf tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.203391 Sep 15 00:55:30.040252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 593/1172] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:29 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:30.178806 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:30.186862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3d47cce6-ac8f-45df-aaca-e7e414c645ff tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1672 microversion: 2.1 time: 0.286685 Sep 15 00:55:30.187438 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 580/1173] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:29 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1672 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:55:31.054547 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:31.055158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:31.061523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:31.062026 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:31.062446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:31.063152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:31.063650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:31.064075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:31.210865 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:31.211506 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:31.218177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:31.218675 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:31.219313 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:31.220600 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:31.221230 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:31.221662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:31.408306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:31.417746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a6837bb0-714d-4503-b769-20af69f78cfb tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1672 microversion: 2.1 time: 0.210622 Sep 15 00:55:31.418647 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 581/1174] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:31 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:31.667635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:31.679365 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:31.680917 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:31.682128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-88cc7a80-1894-4f12-a3d3-fe4adb7331fd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.631569 Sep 15 00:55:31.694893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 594/1175] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:31 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:55:32.455040 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-76be1419-9740-4935-8778-f5e391498a81 req-8f892825-8b87-47d4-9e6f-692d1ce5f536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c186a1d3-16da-4f22-81e3-0e80c8fbd1fc", "name": "network-vif-deleted", "tag": "216baa8c-c4e9-4ef8-b8ae-4f14fcd82ed2"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:32.456149 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:32.456935 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:32.474167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:32.474414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-76be1419-9740-4935-8778-f5e391498a81 req-8f892825-8b87-47d4-9e6f-692d1ce5f536 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:32.474994 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-76be1419-9740-4935-8778-f5e391498a81 req-8f892825-8b87-47d4-9e6f-692d1ce5f536 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:32.475670 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-76be1419-9740-4935-8778-f5e391498a81 req-8f892825-8b87-47d4-9e6f-692d1ce5f536 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:32.476767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:32.477620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:32.478374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:32.479197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:32.479940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:32.500393 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-76be1419-9740-4935-8778-f5e391498a81 req-8f892825-8b87-47d4-9e6f-692d1ce5f536 service nova] Creating event network-vif-deleted:216baa8c-c4e9-4ef8-b8ae-4f14fcd82ed2 for instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc on hv-cinder-85752 Sep 15 00:55:32.510893 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-76be1419-9740-4935-8778-f5e391498a81 req-8f892825-8b87-47d4-9e6f-692d1ce5f536 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066604 Sep 15 00:55:32.513791 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 595/1176] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:32.712174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:32.712992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:32.720702 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:32.721529 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:32.722201 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:32.723174 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:32.723876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:32.724540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:32.826339 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5307118357e44ffbff5074ae4a94c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9d9cf3606845ec964dd8320126293e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:32.837842 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4d39f9c0-3d9d-420e-8ba4-1a2ce081cc29 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 200 len: 1605 microversion: 2.1 time: 0.389364 Sep 15 00:55:32.840442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 582/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:32 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 1605 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:55:32.909024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:32.918735 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:32.920640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:32.921967 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c7a893b1-ed49-43bc-b84d-9c72c777fa62 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.217861 Sep 15 00:55:32.928190 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 596/1178] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:32 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:55:33.864787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:33.865593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:33.874323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:33.875433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:33.876338 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:33.877152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:33.877833 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:33.878334 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:33.893753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] HTTP exception thrown: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Request method failure captured: Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc HTTP/1.1 Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInV1YAp3RkRvuhAXqdAjRzTr155f6tjrLS0v45LN6_masbvjAaqieSsYqzT-IX1F94CLXuvyy56sejqhT6qIPAFc86cIyBj2L9v_r9nbCkkvrfgTYYRp6pGU_9Tm3rIjdyOEZazZSgN_gx2AfWVISwr3PjAdDu2-aWVWfXBzo4D_D6U Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:55:33.895573 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6a9d9cf3606845ec964dd8320126293e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6a9d9cf3606845ec964dd8320126293e"}]}] Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: c5307118357e44ffbff5074ae4a94c9d Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:33.897245 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': 'c186a1d3-16da-4f22-81e3-0e80c8fbd1fc'} Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:55:33.898176 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:33.899677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:33.900991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Returning 404 to user: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:55:33.901638 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fce4d6c6-e251-4a06-bed0-b01ca2e317b7 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 404 len: 111 microversion: 2.1 time: 0.041737 Sep 15 00:55:33.905984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 583/1179] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:33 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:55:33.910686 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-98b0d15b-2b4d-4a6d-95d5-6de5aa3d502d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '.version_select at 0x7f2f207ebee0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:33.931337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-98b0d15b-2b4d-4a6d-95d5-6de5aa3d502d tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362082669" status: 202 len: 0 microversion: 2.1 time: 0.024431 Sep 15 00:55:33.932343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 597/1180] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 15 00:55:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362082669 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 00:55:33.951068 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:33.952183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:33.958412 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:33.958904 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:33.959350 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:33.960092 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:33.960705 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:33.961139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:34.364257 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:34.377598 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:34.379410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:34.380667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-bb914c4d-99fa-493c-bfba-2be484c39806 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.435230 Sep 15 00:55:34.381238 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 584/1181] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:33 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:35.407449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:35.408110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:35.414829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:35.415457 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:35.416110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:35.417027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:35.417654 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:35.418082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:35.584597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:35.594480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:35.596814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:35.600614 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-af95e702-a010-4f49-992a-1fc181b64b09 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.197227 Sep 15 00:55:35.601906 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 598/1182] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:35 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:36.626322 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:36.626969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:36.633989 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:36.634490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:36.634938 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:36.635699 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:36.636159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:36.636592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:36.775043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:36.784548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:36.786013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:36.787250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1e5f5377-9dbc-4666-94a0-4efc2bebe328 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1744 microversion: 2.20 time: 0.165375 Sep 15 00:55:36.788151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 585/1183] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:36 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:36.979644 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:36.980135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:36.986511 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:36.986999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:36.987438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:36.988158 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:36.988616 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:36.989044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:37.002581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] HTTP exception thrown: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Request method failure captured: Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc HTTP/1.1 Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV1YAp3RkRvuhAXqdAjRzTr155f6tjrLS0v45LN6_masbvjAaqieSsYqzT-IX1F94CLXuvyy56sejqhT6qIPAFc86cIyBj2L9v_r9nbCkkvrfgTYYRp6pGU_9Tm3rIjdyOEZazZSgN_gx2AfWVISwr3PjAdDu2-aWVWfXBzo4D_D6U Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:55:37.004266 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6a9d9cf3606845ec964dd8320126293e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6a9d9cf3606845ec964dd8320126293e"}]}] Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: c5307118357e44ffbff5074ae4a94c9d Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.005802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'c186a1d3-16da-4f22-81e3-0e80c8fbd1fc'} Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:55:37.006628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.008082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.009512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Returning 404 to user: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:55:37.009512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e39b8922-77d2-49e8-9aa8-585a799649b9 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 404 len: 111 microversion: 2.1 time: 0.029915 Sep 15 00:55:37.009512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 599/1184] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:55:36 2022] DELETE /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:55:37.014327 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:37.014942 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c186a1d3-16da-4f22-81e3-0e80c8fbd1fc] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:37.021381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:37.021861 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:37.022294 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:37.022982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:37.023433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:37.023889 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:37.037374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] HTTP exception thrown: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Request method failure captured: Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc HTTP/1.1 Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInV1YAp3RkRvuhAXqdAjRzTr155f6tjrLS0v45LN6_masbvjAaqieSsYqzT-IX1F94CLXuvyy56sejqhT6qIPAFc86cIyBj2L9v_r9nbCkkvrfgTYYRp6pGU_9Tm3rIjdyOEZazZSgN_gx2AfWVISwr3PjAdDu2-aWVWfXBzo4D_D6U Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:55:37.038891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6a9d9cf3606845ec964dd8320126293e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6a9d9cf3606845ec964dd8320126293e"}]}] Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: c5307118357e44ffbff5074ae4a94c9d Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.040459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': 'c186a1d3-16da-4f22-81e3-0e80c8fbd1fc'} Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:55:37.041266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. Sep 15 00:55:37.042507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:37.043637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Returning 404 to user: Instance c186a1d3-16da-4f22-81e3-0e80c8fbd1fc could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:55:37.043637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-54d3a12c-8731-41af-bc80-5f8fd32b7139 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc" status: 404 len: 111 microversion: 2.1 time: 0.029780 Sep 15 00:55:37.043637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 586/1185] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:37 2022] GET /compute/v2.1/servers/c186a1d3-16da-4f22-81e3-0e80c8fbd1fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:55:37.813914 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:37.814448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:37.820356 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:37.820840 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:37.821274 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:37.821962 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:37.822414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:37.822840 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:37.949625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:37.953520 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:37.959869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:37.961407 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:37.962670 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3730d030-c02b-4b6a-b19c-1261d43e7f98 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1744 microversion: 2.20 time: 0.152723 Sep 15 00:55:37.963309 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 600/1186] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:37 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:38.176260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:38.176767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:38.183168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:38.183685 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:38.184121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:38.184810 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:38.185258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:38.185679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:38.199121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] HTTP exception thrown: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Request method failure captured: Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: DELETE /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 HTTP/1.1 Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInV1YAp3RkRvuhAXqdAjRzTr155f6tjrLS0v45LN6_masbvjAaqieSsYqzT-IX1F94CLXuvyy56sejqhT6qIPAFc86cIyBj2L9v_r9nbCkkvrfgTYYRp6pGU_9Tm3rIjdyOEZazZSgN_gx2AfWVISwr3PjAdDu2-aWVWfXBzo4D_D6U Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:55:38.200673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6a9d9cf3606845ec964dd8320126293e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6a9d9cf3606845ec964dd8320126293e"}]}] Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: c5307118357e44ffbff5074ae4a94c9d Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.202235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': 'c1d301ea-7505-4d72-8061-827894477da0'} Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:55:38.203142 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.205216 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.206662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Returning 404 to user: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:55:38.206662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-990d3697-a4bb-4967-8513-a9f21a885973 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 404 len: 111 microversion: 2.1 time: 0.029782 Sep 15 00:55:38.206662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 587/1187] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:55:38 2022] DELETE /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:55:38.211396 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:38.212086 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] [instance: c1d301ea-7505-4d72-8061-827894477da0] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:38.219156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:38.219717 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:38.220156 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:38.220860 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:38.221315 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:38.221741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:38.236031 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] HTTP exception thrown: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Request method failure captured: Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 HTTP/1.1 Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInV1YAp3RkRvuhAXqdAjRzTr155f6tjrLS0v45LN6_masbvjAaqieSsYqzT-IX1F94CLXuvyy56sejqhT6qIPAFc86cIyBj2L9v_r9nbCkkvrfgTYYRp6pGU_9Tm3rIjdyOEZazZSgN_gx2AfWVISwr3PjAdDu2-aWVWfXBzo4D_D6U Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:55:38.237652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6a9d9cf3606845ec964dd8320126293e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6a9d9cf3606845ec964dd8320126293e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6a9d9cf3606845ec964dd8320126293e"}]}] Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 6a9d9cf3606845ec964dd8320126293e Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1714807484 Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: c5307118357e44ffbff5074ae4a94c9d Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeTestJSON-1714807484-project Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.239281 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'c1d301ea-7505-4d72-8061-827894477da0'} Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:55:38.240241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. Sep 15 00:55:38.241683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:55:38.243021 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] Returning 404 to user: Instance c1d301ea-7505-4d72-8061-827894477da0 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:55:38.243021 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e74e2d05-2abd-4d21-807c-c061dd62bf97 tempest-AttachVolumeTestJSON-1714807484 tempest-AttachVolumeTestJSON-1714807484-project] 10.222.0.15 "GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0" status: 404 len: 111 microversion: 2.1 time: 0.031858 Sep 15 00:55:38.243307 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 601/1188] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:55:38 2022] GET /compute/v2.1/servers/c1d301ea-7505-4d72-8061-827894477da0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:55:38.989190 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:38.989786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:38.995918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:38.996633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:38.997078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:38.997779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:38.998235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:38.998666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:39.225041 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:39.233696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:39.235062 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:39.236324 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2a918b41-ddc0-44b8-bf29-9a11709e48dd tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1744 microversion: 2.20 time: 0.251710 Sep 15 00:55:39.236932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 588/1189] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:38 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1744 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:40.189642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-648337b4-a63a-4ae2-ac2c-9c6fc008b314 req-75c28d28-2716-47eb-945d-3b65e9a72d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c270acf-24d9-4d2e-bf97-2f487bd44a96", "name": "network-vif-plugged", "status": "completed", "tag": "9e2fa835-2b12-4126-9efe-5387a46e4c0c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:40.199639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-648337b4-a63a-4ae2-ac2c-9c6fc008b314 req-75c28d28-2716-47eb-945d-3b65e9a72d10 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:40.200194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-648337b4-a63a-4ae2-ac2c-9c6fc008b314 req-75c28d28-2716-47eb-945d-3b65e9a72d10 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:40.200689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-648337b4-a63a-4ae2-ac2c-9c6fc008b314 req-75c28d28-2716-47eb-945d-3b65e9a72d10 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:40.212238 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-648337b4-a63a-4ae2-ac2c-9c6fc008b314 req-75c28d28-2716-47eb-945d-3b65e9a72d10 service nova] Creating event network-vif-plugged:9e2fa835-2b12-4126-9efe-5387a46e4c0c for instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 on hv-cinder-85752 Sep 15 00:55:40.219559 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-648337b4-a63a-4ae2-ac2c-9c6fc008b314 req-75c28d28-2716-47eb-945d-3b65e9a72d10 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183043 Sep 15 00:55:40.220172 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 602/1190] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:55:40.264219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:40.264970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:40.274153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:40.274678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:40.275246 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:40.275992 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:40.276452 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:40.276882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:40.496277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:40.508504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:40.510790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:40.512136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f8f1b7af-3a42-49cd-a0b5-3ac3ebecfe07 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1744 microversion: 2.20 time: 0.253274 Sep 15 00:55:40.527508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 589/1191] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:40 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1744 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:41.540711 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:41.541418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:41.547671 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:41.548173 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:41.548611 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:41.549322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:41.549777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:41.550205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:41.723908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:41.732607 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:41.734176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:41.735394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8aadd728-cfa3-4d03-8c8f-266566191159 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1744 microversion: 2.20 time: 0.200207 Sep 15 00:55:41.736071 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 603/1192] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:41 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:42.767795 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:42.768676 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:42.776901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:42.777666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:42.778388 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:42.779372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:42.779932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:42.780559 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:42.919849 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:42.930278 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:42.932017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:42.933204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-086f1a7d-cafd-4082-ba0d-69fa8787b188 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.171500 Sep 15 00:55:42.934372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 590/1193] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:42 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:43.961670 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:43.962444 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:43.969063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:43.970336 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:43.971004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:43.971767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:43.972256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:43.972746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:44.115399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:44.126337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:44.128191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:44.129382 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6f1cf07e-4400-4039-a919-48368504b93f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.172086 Sep 15 00:55:44.143569 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 604/1194] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:43 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:45.154552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:45.156609 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:45.167751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:45.168582 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:45.169033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:45.169770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:45.170233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:45.170664 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:45.175753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:45.350028 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:45.373622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:45.379325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:45.388299 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-aa5b500b-4160-4a43-a282-495dd668ceda tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.230937 Sep 15 00:55:45.400751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 591/1195] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:45 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:46.428204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:46.429603 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:46.436241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:46.436805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:46.437345 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:46.438153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:46.438826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:46.439259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:46.589296 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:46.602421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:46.604797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:46.606330 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4460f55a-bc42-4534-8824-ae9a82a294af tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.182285 Sep 15 00:55:46.612725 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 605/1196] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:46 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:47.633050 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:47.633662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:47.640522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:47.641270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:47.641918 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:47.642828 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:47.643444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:47.644043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:47.795843 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:47.807472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:47.811354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:47.811354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0c320183-4607-466f-af34-8c5c88b17f83 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.181035 Sep 15 00:55:47.823767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 592/1197] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:47 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:48.838398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:48.839014 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:48.846498 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:48.846985 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:48.847428 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:48.848168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:48.848616 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:48.849045 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:48.988566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:48.997794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:48.999256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:49.000504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fc18fa01-9819-4ad4-80cc-b556a7815dd3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.166071 Sep 15 00:55:49.001384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 606/1198] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:48 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:50.037616 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:50.042344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:50.049981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:50.054153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:50.055835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:50.057013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:50.057790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:50.058507 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:50.203727 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:50.213016 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:50.214696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:50.216303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b7d0c37f-9388-4b38-a89f-13c65c7b8303 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.190003 Sep 15 00:55:50.235812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 593/1199] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:50 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:51.247745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:51.249039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:51.257176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:51.257672 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:51.259220 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:51.260830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:51.262247 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:51.263512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:51.457559 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:51.468355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:51.470073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:51.478834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-787a43f1-1465-44d1-9baf-d85171d7e486 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.230947 Sep 15 00:55:51.478834 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 607/1200] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:51 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:52.502462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:52.502982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:52.518815 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:52.519510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:52.519915 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:52.520803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:52.521408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:52.521988 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:52.699742 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:52.708833 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:52.710710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:52.712097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-88c32cfc-5907-41f3-8d4b-d2b8190cb6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1739 microversion: 2.20 time: 0.214219 Sep 15 00:55:52.727979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 594/1201] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:52 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:53.742360 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:53.743051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:53.749512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:53.750070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:53.750578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:53.752168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:53.752698 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:53.753208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:53.894692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:53.905785 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:53.907887 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:53.909128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c4a71b21-57cf-4bef-86ac-0f212670f243 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1721 microversion: 2.20 time: 0.170790 Sep 15 00:55:53.909925 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 608/1202] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:53 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:54.939336 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:54.939898 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:54.946223 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:54.946699 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:54.947130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:54.947850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:54.948301 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:54.948720 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:55.080810 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:55.089239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:55.090688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:55.091886 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6b9dd4f8-af09-44b1-a284-b6cffa78da35 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1721 microversion: 2.20 time: 0.157229 Sep 15 00:55:55.092442 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 595/1203] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:54 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:56.120205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:56.120817 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:56.128398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:56.128890 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:56.129334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:56.130041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:56.130499 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:56.130926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:56.268240 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:56.277244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:56.278689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:56.280035 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-02d75b50-c9d0-4104-8ea0-684afa530e22 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1721 microversion: 2.20 time: 0.163973 Sep 15 00:55:56.292244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 609/1204] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:56 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:57.311929 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:57.312574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:57.318151 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:57.320056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:57.320639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:57.321082 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:57.321783 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:57.322241 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:57.322668 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:57.458117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:57.466196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:57.467663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:57.468821 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4746af6e-fc29-43fb-bb29-19cbeeb3b137 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1664 microversion: 2.20 time: 0.160671 Sep 15 00:55:57.469377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 596/1205] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:57 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:57.494025 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b32135-299c-4c88-9b82-b20de4a4dafe"}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:57.496625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:57.499078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:57.505098 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:57.505588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:57.506033 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:57.506733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:57.507191 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:57.507651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:57.789342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-21dd1367-b64c-48ef-a7cb-d4dba4a7880e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299176 Sep 15 00:55:57.790011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 610/1206] 10.222.0.15 () {62 vars in 1364 bytes} [Thu Sep 15 00:55:57 2022] POST /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 00:55:57.921432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:57.921938 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:57.928467 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:57.928956 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:57.929400 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:57.930121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:57.930574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:57.931005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:58.098924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-8d53c264-a3e0-419c-9e3c-808a9e82f646 req-bcc3f8ac-9301-49c8-b487-7b3f12d84629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c270acf-24d9-4d2e-bf97-2f487bd44a96", "name": "network-vif-unplugged", "status": "completed", "tag": "9e2fa835-2b12-4126-9efe-5387a46e4c0c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:58.111376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8d53c264-a3e0-419c-9e3c-808a9e82f646 req-bcc3f8ac-9301-49c8-b487-7b3f12d84629 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:58.113293 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8d53c264-a3e0-419c-9e3c-808a9e82f646 req-bcc3f8ac-9301-49c8-b487-7b3f12d84629 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:58.113293 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-8d53c264-a3e0-419c-9e3c-808a9e82f646 req-bcc3f8ac-9301-49c8-b487-7b3f12d84629 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:58.124689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.compute.server_external_events [req-8d53c264-a3e0-419c-9e3c-808a9e82f646 req-bcc3f8ac-9301-49c8-b487-7b3f12d84629 service nova] Unable to find a host for instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96. Dropping event network-vif-unplugged {{(pid=127199) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 00:55:58.125581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-8d53c264-a3e0-419c-9e3c-808a9e82f646 req-bcc3f8ac-9301-49c8-b487-7b3f12d84629 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035694 Sep 15 00:55:58.126656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 611/1207] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 00:55:58.212107 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9727ec61-599f-411b-b7e3-a1b1a72677de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/os-volume_attachments/59b32135-299c-4c88-9b82-b20de4a4dafe" status: 202 len: 0 microversion: 2.20 time: 0.294502 Sep 15 00:55:58.212711 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 597/1208] 10.222.0.15 () {60 vars in 1457 bytes} [Thu Sep 15 00:55:57 2022] DELETE /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/os-volume_attachments/59b32135-299c-4c88-9b82-b20de4a4dafe => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:55:58.279376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:55:58.279998 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:58.286588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:58.287077 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:58.287538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:58.288249 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:58.288723 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:58.289230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:58.320133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127199) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 00:55:58.396639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1ba010cf-928b-4d18-81fa-59737977c6e9 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "POST /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/action" status: 202 len: 0 microversion: 2.20 time: 0.121054 Sep 15 00:55:58.397559 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 612/1209] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 15 00:55:58 2022] POST /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:55:58.405926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:58.406541 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:58.414481 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:58.415144 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:58.415942 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:58.416922 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:58.417130 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:58.417545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:58.607501 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:58.616971 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:58.618681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:58.619895 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3a1a98a6-25f7-4069-9eed-33a19de24586 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1672 microversion: 2.20 time: 0.217920 Sep 15 00:55:58.625396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 598/1210] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:58 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1672 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:55:59.648488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:55:59.650044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:55:59.657678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:59.658344 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:59.658788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:59.659537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:55:59.660024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:55:59.660775 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:55:59.796589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:59.806291 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:59.807829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:55:59.809077 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f45f4fd8-32b9-4094-9d87-b83506064f6c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.166863 Sep 15 00:55:59.809622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 613/1211] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:55:59 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:56:00.836502 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:00.837124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:00.843714 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:00.844398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:00.845335 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:00.846280 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:00.846916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:00.847434 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:01.026669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:01.038073 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:01.039611 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:01.040841 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8a3a0044-e3cc-4460-994c-7ca28f62ab9a tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.208338 Sep 15 00:56:01.041711 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 599/1212] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:00 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:56:02.070469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:02.071070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:02.085082 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:02.085584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:02.086024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:02.086742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:02.087353 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:02.087822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:02.243773 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:02.255209 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:02.257164 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:02.258552 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f64cc896-ac74-44f2-8b3f-c0afc3e8cfb7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.192180 Sep 15 00:56:02.272181 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 614/1213] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:02 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:03.286097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:03.286858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:03.296984 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:03.297474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:03.303321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:03.306550 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:03.307046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:03.307570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:03.484403 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:03.509120 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:03.510933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:03.512329 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-50b8cc37-cbe6-48bb-8848-afa75dfe1146 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.230757 Sep 15 00:56:03.512899 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 600/1214] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:03 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:04.541478 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:04.542094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:04.549171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:04.549654 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:04.550096 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:04.550802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:04.551261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:04.551731 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:04.676982 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:04.680454 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:04.686027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:04.687474 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:04.688678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4729564f-40b0-47ea-b8d8-74acda9cff0c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.151207 Sep 15 00:56:04.689238 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 615/1215] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:04 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:05.714432 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:05.715139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:05.723044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:05.723903 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:05.724419 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:05.725211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:05.725737 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:05.726328 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:05.863266 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:05.871617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:05.873218 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:05.874546 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-31a6ba05-22a9-4827-9421-23a0e16f0b1d tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.164030 Sep 15 00:56:05.875378 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 601/1216] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:05 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:06.901011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:06.901605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:06.910031 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:06.910527 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:06.911184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:06.912076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:06.912680 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:06.913112 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:07.072152 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:07.082446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:07.083463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:07.084691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-76830a4c-02f1-40e7-a591-11ee8c7e1c4b tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.187615 Sep 15 00:56:07.085449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 616/1217] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:06 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:08.110650 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:08.111385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:08.117747 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:08.118229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:08.118662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:08.119356 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:08.119839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:08.120270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:08.249866 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:08.258746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:08.260299 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:08.261459 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-278a9c74-8502-4d29-836c-642cc47402de tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.154690 Sep 15 00:56:08.262014 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 602/1218] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:08 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:09.287449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:09.288083 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:09.294879 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:09.295416 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:09.295899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:09.296572 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:09.297054 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:09.297536 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:09.441780 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:09.449822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:09.451354 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:09.452549 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a5fcef78-52bd-4590-91da-93e7871e94d2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.169185 Sep 15 00:56:09.453184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 617/1219] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:09 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:10.273488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1545642555", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:10.325515 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.network.neutron [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] validate_networks() for None {{(pid=127200) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:56:10.478216 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:10.478772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:10.488153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:10.488649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:10.489088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:10.489795 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:10.490252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:10.490898 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:10.616466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Flavor limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:56:10.617075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Image limits 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:56:10.617636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Flavor pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:56:10.618120 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Image pref 0:0:0 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:56:10.618614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.virt.hardware [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127200) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:56:10.629132 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:10.629706 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:10.630218 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:10.631033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:10.631711 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:10.632346 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:10.658004 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Getting quotas for project 01d7d32119984a1aacc7109e74d9fe01. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:56:10.662805 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Getting quotas for user 25addc94df284d82b633b3a29954507e and project 01d7d32119984a1aacc7109e74d9fe01. Resources: {'instances', 'ram', 'cores'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:56:10.663443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:10.672267 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:10.677619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:10.679230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9ae5f35b-6e23-4e8a-9aad-0b0e2c8239eb tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.205160 Sep 15 00:56:10.679827 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 618/1220] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:10 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:56:10.682139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Going to run 1 instances... {{(pid=127200) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:56:10.684885 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127200) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:56:10.730826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [6b8183ce-ebc0-45d4-9c8e-369e5138b2bb] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 00:56:11.705918 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:11.706524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:11.713048 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:11.713533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:11.713967 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:11.714678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:11.715131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:11.715575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:11.744587 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO oslo.messaging._drivers.impl_rabbit [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [6b8183ce-ebc0-45d4-9c8e-369e5138b2bb] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 52474. Sep 15 00:56:11.749692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9b9c0c10-4c2f-4e31-8db2-574143f3e771 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479878 Sep 15 00:56:11.751702 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 603/1221] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:56:11.763027 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cdb84b76-7593-4d6b-9bfe-9b1688507ac3 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:11.763932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cdb84b76-7593-4d6b-9bfe-9b1688507ac3 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:11.824416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-cdb84b76-7593-4d6b-9bfe-9b1688507ac3 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:11.831566 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-cdb84b76-7593-4d6b-9bfe-9b1688507ac3 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1215 microversion: 2.1 time: 0.072353 Sep 15 00:56:11.832225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 604/1222] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:11 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:56:11.884065 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:11.892690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:11.894171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:11.895452 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-95305461-b6e5-4ca2-b258-d3f1bd139951 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.193563 Sep 15 00:56:11.897261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 619/1223] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:11 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:56:12.855535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:12.864063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:12.878179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:12.878668 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:12.879100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:12.879844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:12.880560 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:12.880982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:12.920205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:12.920839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:12.932374 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:12.932881 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:12.933328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:12.934062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:12.934523 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:12.934952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:12.958444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:12.966779 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9b01c804-580c-47da-89e1-6731cc0d1318 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1219 microversion: 2.1 time: 0.115091 Sep 15 00:56:12.967352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 605/1224] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:12 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:13.070473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:13.081264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:13.083432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:13.085439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-08df5491-c5a8-4191-8e78-9df29b6b686f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.168835 Sep 15 00:56:13.086392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 620/1225] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:12 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:13.989473 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:13.990118 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:13.996696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:13.997175 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:13.997609 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:13.998295 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:13.998746 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:13.999168 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:14.114272 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:14.114903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:14.121242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:14.121744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:14.122187 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:14.122915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:14.123385 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:14.123846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:14.265133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:14.274079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:14.275538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:14.276701 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c488c89d-f88f-46a6-9930-9b1386014c77 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.168348 Sep 15 00:56:14.277264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 621/1226] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:14 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:56:14.308926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:14.317043 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b93d1edf-f724-4c96-9904-6a029e96ac57 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1219 microversion: 2.1 time: 0.331441 Sep 15 00:56:14.317604 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 606/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:13 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1219 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:15.301968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:15.302516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:15.308897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:15.309390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:15.309829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:15.310530 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:15.310989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:15.311424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:15.339920 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:15.340540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:15.347763 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:15.348258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:15.348699 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:15.349407 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:15.349894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:15.350325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:15.354372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:15.413166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:15.420834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ddd82469-f7f1-425d-a955-07df40266556 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1219 microversion: 2.1 time: 0.084739 Sep 15 00:56:15.421413 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 607/1228] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:15 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:56:15.440638 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:15.448733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:15.450175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:15.451339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1e314a7d-e50f-4fea-b0cf-bfef2730c0ef tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.153430 Sep 15 00:56:15.451919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 622/1229] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:15 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:16.443346 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:16.444116 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:16.450596 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:16.451712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:16.452159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:16.452868 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:16.453332 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:16.453765 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:16.462888 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-15547720", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-309604362", "security_groups": [{"name": "tempest-secgroup-smoke-305757992"}], "block_device_mapping_v2": [{"uuid": "1dd1a04a-2326-42fb-8824-9cbe505e2f2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0487b0cb-031a-4188-bee6-95c6ebd2b4a3"}]}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:16.516314 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:16.523782 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d5effaa7-6977-4c70-bf24-fedbe63ad57c tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1219 microversion: 2.1 time: 0.084280 Sep 15 00:56:16.524466 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 608/1230] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:16 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:16.528954 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:16.529555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:16.536096 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:16.536698 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:16.537516 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:16.537835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:16.538287 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:16.538707 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:16.576198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] validate_networks() for [('0487b0cb-031a-4188-bee6-95c6ebd2b4a3', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:56:16.670673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:16.679143 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:16.680712 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:16.681972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4d68fdfe-c8b7-4291-b244-91c094386684 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.156567 Sep 15 00:56:16.682787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 609/1231] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:16 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:16.938482 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:56:16.938928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:56:16.939402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:56:16.939846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:56:16.940256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:56:16.948892 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:16.949372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:16.949808 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:16.950537 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:16.950993 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:16.951417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:16.968198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Getting quotas for project 53d8d76185c44a159439c0f7a0e88b31. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:56:16.972664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Getting quotas for user d308262224af475091e6aa494ea839b1 and project 53d8d76185c44a159439c0f7a0e88b31. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:56:17.027273 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:56:17.029390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dd1a04a-2326-42fb-8824-9cbe505e2f2b',volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:56:17.158588 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2bae2d85-ae38-4f94-b9f2-983ea12dd15c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.699310 Sep 15 00:56:17.159246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 623/1232] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:56:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 00:56:17.170386 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ba1f6bd1-02a1-409d-ab71-df0d91bec464 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:17.171008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ba1f6bd1-02a1-409d-ab71-df0d91bec464 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:17.223839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-ba1f6bd1-02a1-409d-ab71-df0d91bec464 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:17.231120 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ba1f6bd1-02a1-409d-ab71-df0d91bec464 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1092 microversion: 2.1 time: 0.064390 Sep 15 00:56:17.233417 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 610/1233] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:17 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:17.546524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:17.547150 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:17.554146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:17.554641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:17.555079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:17.555797 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:17.556257 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:17.556685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:17.615980 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:17.623502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4f06c315-7472-44e9-8e8b-dc63c59dc4ba tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1219 microversion: 2.1 time: 0.080813 Sep 15 00:56:17.624020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 624/1234] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:17 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:17.708284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:17.708927 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:17.715979 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:17.716463 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:17.716900 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:17.717592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:17.718048 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:17.718472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:17.845964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:17.854490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:17.855954 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:17.857110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-1f09c6e8-d091-4ffb-a658-a5b54709d037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.152724 Sep 15 00:56:17.857660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 611/1235] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:17 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:18.254232 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:18.254841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:18.260784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:18.261282 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:18.261694 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:18.262386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:18.262980 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:18.263452 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:18.329666 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:18.337720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8e58f268-d51a-4453-babf-ce57590ceb87 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1142 microversion: 2.1 time: 0.087764 Sep 15 00:56:18.338275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 625/1236] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:18 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1142 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:18.647645 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:18.648187 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:18.654169 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:18.654653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:18.655086 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:18.655809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:18.656261 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:18.656691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:18.718817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:18.726773 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-458e7950-b02d-41ae-980a-6260d2781453 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1219 microversion: 2.1 time: 0.083743 Sep 15 00:56:18.727341 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 612/1237] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:18 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:18.884550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:18.885157 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:18.891503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:18.892001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:18.892436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:18.893709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:18.894165 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:18.894591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:19.033392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:19.041869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:19.043357 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:19.044570 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b06e2c70-a29e-48ea-8836-161da528d447 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.163967 Sep 15 00:56:19.045116 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 626/1238] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:18 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:56:19.360667 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:19.361284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:19.368517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:19.369058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:19.369694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:19.370505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:19.370968 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:19.371399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:19.431376 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:19.439806 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a5bcba38-507f-4a7f-aa28-086315189742 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1134 microversion: 2.1 time: 0.083006 Sep 15 00:56:19.440372 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 613/1239] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:19 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1134 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:19.749447 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:19.750375 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:19.757597 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:19.758350 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:19.759027 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:19.760637 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:19.761271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:19.762146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:19.830303 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:19.840128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8463e349-944c-44a6-a28b-37de92bef298 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1285 microversion: 2.1 time: 0.094565 Sep 15 00:56:19.840909 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 627/1240] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:19 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:20.070768 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:20.071312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:20.078213 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:20.078695 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:20.079126 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:20.079888 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:20.080294 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:20.081580 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:20.309374 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:20.319385 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:20.320995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:20.322124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d1db9d9f-7e13-43da-94de-28c925846d03 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.255330 Sep 15 00:56:20.323060 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 614/1241] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:20 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:20.464133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:20.466038 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:20.476656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:20.477766 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:20.478740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:20.480146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:20.481520 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:20.483683 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:20.579337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:20.588494 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8b0eb533-d15d-4572-b7dd-0095dec55013 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1198 microversion: 2.1 time: 0.129635 Sep 15 00:56:20.589067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 628/1242] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:20 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:56:20.865555 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:20.866276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:20.868687 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:20.874109 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:20.874689 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:20.875225 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:20.876059 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:20.877001 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:20.877671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:21.073817 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:21.082695 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b56ba5ee-0ba9-4f69-8318-535cac262fbc tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.221561 Sep 15 00:56:21.083588 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 615/1243] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:20 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:21.351663 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:21.352778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:21.369417 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:21.370224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:21.373391 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:21.374343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:21.374809 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:21.375322 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:21.639182 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:21.651913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:21.653793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:21.655343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c2bccf84-aa3b-48f0-92b2-3f081be733e4 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.311528 Sep 15 00:56:21.656208 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 629/1244] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:21 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:21.675519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:21.676565 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:21.682706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:21.683204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:21.683694 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:21.684409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:21.685220 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:21.685668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:21.719382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-615b7935-44e2-42b2-bb89-1e5374d94911 req-fa665c2a-b9e1-45d2-9a2a-c78c42acc7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed6407b-3728-48e9-aca1-c36a6e166a43", "tag": "d4024891-68b4-45cd-ad0a-de32e7e036c7"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:21.730211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-615b7935-44e2-42b2-bb89-1e5374d94911 req-fa665c2a-b9e1-45d2-9a2a-c78c42acc7a2 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:21.731188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-615b7935-44e2-42b2-bb89-1e5374d94911 req-fa665c2a-b9e1-45d2-9a2a-c78c42acc7a2 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:21.731863 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-615b7935-44e2-42b2-bb89-1e5374d94911 req-fa665c2a-b9e1-45d2-9a2a-c78c42acc7a2 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:21.746381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-615b7935-44e2-42b2-bb89-1e5374d94911 req-fa665c2a-b9e1-45d2-9a2a-c78c42acc7a2 service nova] Creating event network-changed:d4024891-68b4-45cd-ad0a-de32e7e036c7 for instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 on hv-cinder-85752 Sep 15 00:56:21.753447 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-615b7935-44e2-42b2-bb89-1e5374d94911 req-fa665c2a-b9e1-45d2-9a2a-c78c42acc7a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183703 Sep 15 00:56:21.754263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 616/1245] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:56:21.917297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:21.925625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0b3e8c8c-7401-4049-8ab6-c4649019d2d3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.268513 Sep 15 00:56:21.926198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 630/1246] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:21 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:22.113499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:22.118882 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:22.130121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:22.132230 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:22.134182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:22.135184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:22.136710 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:22.137569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:22.233567 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-b9e526dd-10c6-403b-8c70-fe50d165b96a req-a135a132-f7f3-4b59-8756-340a7b137b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c270acf-24d9-4d2e-bf97-2f487bd44a96", "name": "network-vif-plugged", "status": "completed", "tag": "9e2fa835-2b12-4126-9efe-5387a46e4c0c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:22.251211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b9e526dd-10c6-403b-8c70-fe50d165b96a req-a135a132-f7f3-4b59-8756-340a7b137b4c service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:22.252926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b9e526dd-10c6-403b-8c70-fe50d165b96a req-a135a132-f7f3-4b59-8756-340a7b137b4c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:22.256458 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-b9e526dd-10c6-403b-8c70-fe50d165b96a req-a135a132-f7f3-4b59-8756-340a7b137b4c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:22.276820 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-b9e526dd-10c6-403b-8c70-fe50d165b96a req-a135a132-f7f3-4b59-8756-340a7b137b4c service nova] Creating event network-vif-plugged:9e2fa835-2b12-4126-9efe-5387a46e4c0c for instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 on hv-cinder-85752 Sep 15 00:56:22.285746 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-b9e526dd-10c6-403b-8c70-fe50d165b96a req-a135a132-f7f3-4b59-8756-340a7b137b4c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055740 Sep 15 00:56:22.286675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 631/1247] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:56:22.297630 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:22.307744 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2b985aa6-dd7d-4fce-82c8-a173a08011d1 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.203977 Sep 15 00:56:22.308970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 617/1248] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:22 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:22.537241 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-664872d3-f570-4d80-a993-7e8559191840 req-a5567840-e135-432f-9b58-b4995d380ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c219172-398a-4d1a-b41b-a12948058ed4", "tag": "1e256011-f270-4453-bb18-eafb005e24f8"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:22.546612 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-664872d3-f570-4d80-a993-7e8559191840 req-a5567840-e135-432f-9b58-b4995d380ba8 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:22.547093 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-664872d3-f570-4d80-a993-7e8559191840 req-a5567840-e135-432f-9b58-b4995d380ba8 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:22.547575 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-664872d3-f570-4d80-a993-7e8559191840 req-a5567840-e135-432f-9b58-b4995d380ba8 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:22.559020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-664872d3-f570-4d80-a993-7e8559191840 req-a5567840-e135-432f-9b58-b4995d380ba8 service nova] Creating event network-changed:1e256011-f270-4453-bb18-eafb005e24f8 for instance 3c219172-398a-4d1a-b41b-a12948058ed4 on hv-cinder-85752 Sep 15 00:56:22.563596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-664872d3-f570-4d80-a993-7e8559191840 req-a5567840-e135-432f-9b58-b4995d380ba8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031362 Sep 15 00:56:22.564183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 632/1249] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:56:22.680625 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:22.681185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:22.687207 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:22.687789 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:22.688235 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:22.688936 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:22.689393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:22.689823 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:22.816300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:22.824293 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:22.825753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:22.826926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9dc6d8f9-25ba-424b-97c3-174c0da20534 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.150417 Sep 15 00:56:22.827508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 618/1250] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:22 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 00:56:22.949344 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:22.949979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:22.956576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:22.957062 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:22.957501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:22.958192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:22.958652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:22.959079 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:23.089986 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:23.098081 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-1a45192c-34c9-4484-a0e5-00693cd44f3c tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.152991 Sep 15 00:56:23.098642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 633/1251] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:22 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:23.330239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:23.330940 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:23.338421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:23.338909 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:23.339352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:23.340079 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:23.340536 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:23.340998 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:23.470295 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:23.478774 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-199f3a08-9f6c-4557-b2be-ee82104f3d33 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.152474 Sep 15 00:56:23.479346 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 619/1252] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:23 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:23.852520 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:23.853133 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:23.859505 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:23.859993 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:23.860429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:23.861122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:23.861578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:23.862004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:23.880276 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=100 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:23.986333 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:23.994339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:23.995822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:23.997110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-56581ba7-b36f-4813-a9c9-663445b0c2d3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.148504 Sep 15 00:56:23.997678 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 634/1253] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:23 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:24.121438 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:24.122051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:24.128666 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:24.129146 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:24.129579 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:24.130265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:24.130783 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:24.131204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:24.261500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:24.269197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6d21f42c-4ad9-4803-860f-8e391d9456ce tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.151624 Sep 15 00:56:24.269765 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 620/1254] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:24 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:24.501596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:24.502384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:24.509067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:24.509552 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:24.509997 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:24.510694 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:24.511149 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:24.511599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:24.639847 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:24.647510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f77ea3f8-f7f5-4d6f-8b48-d9e83d4193de tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.149850 Sep 15 00:56:24.648080 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 635/1255] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:24 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:25.022837 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:25.023462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:25.030008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:25.030500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:25.030941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:25.031681 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:25.032139 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:25.032567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:25.160864 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:25.168951 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:25.170405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:25.171609 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-cdf8a3e8-63ed-426c-b9a2-97d94e1b9011 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.153252 Sep 15 00:56:25.172179 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 621/1256] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:25 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:25.292136 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:25.292713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:25.299192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:25.299718 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:25.300160 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:25.301530 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:25.301989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:25.302421 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:25.431770 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:25.439938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ac2bb843-8afa-4c84-b88d-7dba7c303d37 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.151718 Sep 15 00:56:25.440510 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 636/1257] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:25 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:25.670671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:25.671331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:25.677956 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:25.678548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:25.679030 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:25.679858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:25.680395 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:25.680893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:25.815941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:25.823504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-40730ca8-5f80-4e30-963c-886a84bea779 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.157164 Sep 15 00:56:25.824078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 622/1258] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:25 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:26.197477 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:26.198193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:26.204516 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:26.205004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:26.205650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:26.206360 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:26.206846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:26.207843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:26.462404 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:26.463026 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:26.469571 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:26.470069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:26.470522 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:26.471231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:26.471720 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:26.472152 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:26.476233 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:26.485978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:26.487598 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:26.489367 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-52ab1e72-e392-4da6-988b-42fcccab97b6 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.296058 Sep 15 00:56:26.489926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 637/1259] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:26 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:26.603451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:26.611185 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-157290bc-9ceb-4ce3-993e-4d85c25fae0a tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.152639 Sep 15 00:56:26.611787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 623/1260] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:26 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:56:26.846221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:26.847005 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:26.853634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:26.854230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:26.854885 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:26.855635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:26.856097 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:26.856710 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:26.958832 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:26.979147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:26.990386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:26.998013 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-605fdd1a-8445-4f99-a58c-267242dc5248 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.155666 Sep 15 00:56:26.998578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 638/1261] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:26 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:27.514517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:27.515135 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:27.517113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=10 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:27.517809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:27.523822 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:27.524308 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:27.524744 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:27.525437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:27.525892 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:27.526314 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:27.635137 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:27.635871 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:27.638302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:27.643643 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:27.644328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:27.645311 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:27.646029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:27.646491 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:27.646922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:27.652366 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:27.660706 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:27.662155 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:27.663353 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-9edaa1cc-e4ea-444b-ad7a-9ef3d74c99a2 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1730 microversion: 2.20 time: 0.152909 Sep 15 00:56:27.664262 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 624/1262] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:27 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:27.784005 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:27.791629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d55ce87d-976b-44db-955e-f6a968536687 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.160345 Sep 15 00:56:27.792193 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 639/1263] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:27 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:56:28.020972 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:28.021509 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:28.027397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:28.028313 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:28.028313 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:28.029017 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:28.029470 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:28.029890 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:28.044174 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=100 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:28.159241 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:28.166749 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b0876820-7030-4096-ae72-6f8f1f2b220e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.149712 Sep 15 00:56:28.167305 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 625/1264] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:28 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:28.427429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-36c5ab92-e782-48e2-80aa-657022dc86b2 req-b44a1110-28d3-4ef1-90bb-bfa8c7adec5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed6407b-3728-48e9-aca1-c36a6e166a43", "name": "network-vif-plugged", "status": "completed", "tag": "d4024891-68b4-45cd-ad0a-de32e7e036c7"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:28.441580 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-36c5ab92-e782-48e2-80aa-657022dc86b2 req-b44a1110-28d3-4ef1-90bb-bfa8c7adec5c service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:28.442237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-36c5ab92-e782-48e2-80aa-657022dc86b2 req-b44a1110-28d3-4ef1-90bb-bfa8c7adec5c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:28.442762 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-36c5ab92-e782-48e2-80aa-657022dc86b2 req-b44a1110-28d3-4ef1-90bb-bfa8c7adec5c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:28.455271 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-36c5ab92-e782-48e2-80aa-657022dc86b2 req-b44a1110-28d3-4ef1-90bb-bfa8c7adec5c service nova] Creating event network-vif-plugged:d4024891-68b4-45cd-ad0a-de32e7e036c7 for instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 on hv-cinder-85752 Sep 15 00:56:28.460742 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-36c5ab92-e782-48e2-80aa-657022dc86b2 req-b44a1110-28d3-4ef1-90bb-bfa8c7adec5c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037396 Sep 15 00:56:28.461631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 640/1265] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:56:28.687856 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:28.688534 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:28.694944 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:28.695435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:28.695908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:28.696617 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:28.697075 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:28.697505 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:28.815295 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:28.816262 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:28.823290 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:28.823840 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:28.824275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:28.824984 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:28.825441 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:28.825864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:28.830567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:28.839220 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:28.840743 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:28.841909 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-df7b2a70-9495-44d5-b8e6-287d6cb558a0 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1717 microversion: 2.20 time: 0.157968 Sep 15 00:56:28.842499 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 626/1266] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:56:28 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:56:28.957788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:28.965480 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5300d4cc-70f2-4b43-aa39-44bd3e939b89 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.154939 Sep 15 00:56:28.966054 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 641/1267] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:28 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:56:29.189723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:29.190330 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:29.196809 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:29.197290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:29.197724 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:29.198409 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:29.198858 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:29.199281 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:29.329753 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:29.338003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-45419a4e-56c6-4f78-846e-26410a7d39f6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.152099 Sep 15 00:56:29.338561 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 627/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:29 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:29.989168 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:29.989706 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:29.996060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:29.996550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:29.996989 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:29.997691 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:29.998153 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:29.998581 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:30.132392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:30.140112 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7ed78ff2-24eb-4ac6-b105-495e9bbdccd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.155540 Sep 15 00:56:30.140674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 642/1269] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:29 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:30.360096 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:30.360762 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:30.367165 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:30.367676 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:30.368112 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:30.368799 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:30.369247 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:30.369665 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:30.497540 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:30.505905 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d462cc25-b613-45ec-bb02-c60fcad40778 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1315 microversion: 2.1 time: 0.149729 Sep 15 00:56:30.506482 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 628/1270] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:30 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:31.163131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:31.163765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:31.170154 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:31.170639 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:31.171074 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:31.171799 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:31.172251 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:31.172671 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:31.301668 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:31.309912 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f5e049af-e89b-46c0-ad4f-5441df5232d7 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.150661 Sep 15 00:56:31.310476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 643/1271] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:31 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:31.529894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:31.530511 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:31.537706 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:31.538196 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:31.538642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:31.539345 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:31.539835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:31.540261 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:31.671687 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:31.679416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-97f5f705-d79f-41b4-8aa9-b347f154bd7b tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1465 microversion: 2.1 time: 0.153470 Sep 15 00:56:31.680021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 629/1272] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:31 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:31.725905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:31.726357 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:31.732355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:31.732839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:31.733269 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:31.733958 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:31.734409 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:31.734829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:31.759580 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:56:31.834974 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-ddc1dc82-c4ab-4dda-8ce9-1a68d5f77feb tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 204 len: 0 microversion: 2.1 time: 0.113031 Sep 15 00:56:31.836030 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 644/1273] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:56:31 2022] DELETE /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:56:31.844311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:31.844989 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:31.852229 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:31.852726 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:31.853166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:31.853916 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:31.854377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:31.854806 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:31.983504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:31.991131 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-58e30481-a2d3-4db5-b9e4-781ffa698df6 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1471 microversion: 2.1 time: 0.150808 Sep 15 00:56:31.991735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 630/1274] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:31 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:32.333565 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:32.334264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:32.340584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:32.341067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:32.341501 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:32.342190 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:32.342645 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:32.343067 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:32.476057 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:32.483727 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-cbb13a68-07db-4e78-b985-2de04359f4e6 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.154933 Sep 15 00:56:32.484299 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 645/1275] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:32 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:56:33.014936 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:33.015472 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:33.021901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:33.022381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:33.022812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:33.023526 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:33.023983 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:33.024409 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:33.150284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:33.158100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-32759221-a4e3-4212-b99b-ccd167e5e159 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1471 microversion: 2.1 time: 0.147149 Sep 15 00:56:33.158671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 631/1276] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:33 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:33.507756 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:33.508361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:33.514759 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:33.515255 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:33.515732 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:33.516439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:33.516899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:33.517332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:33.646300 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:33.654763 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c787e1f1-6b16-40b5-bda2-2e34d36b5817 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.151503 Sep 15 00:56:33.655338 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 646/1277] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:33 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:34.182180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:34.182735 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:34.189193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:34.189678 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:34.190117 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:34.190813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:34.191264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:34.191719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:34.322390 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:34.329995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-7b13e9ea-05e5-4207-9b3d-74cf93de7f8d tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1471 microversion: 2.1 time: 0.152360 Sep 15 00:56:34.330558 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 632/1278] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:34 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:34.677294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:34.677915 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:34.684577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:34.685068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:34.685508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:34.686200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:34.686651 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:34.687073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:34.816770 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:34.824605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9257c07b-e01b-4e10-b74b-8b85a2fddb6e tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.151307 Sep 15 00:56:34.825204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 647/1279] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:34 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:35.352113 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:35.353421 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:35.360436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:35.360867 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:35.361307 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:35.362018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:35.362477 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:35.363023 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:35.432995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25addc94df284d82b633b3a29954507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d7d32119984a1aacc7109e74d9fe01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:35.433225 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-28025487-cffc-46c6-9c9d-f6859dfdfa8a req-8c1175f9-224c-4da1-961a-6bc32ae96bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed6407b-3728-48e9-aca1-c36a6e166a43", "name": "network-vif-deleted", "tag": "d4024891-68b4-45cd-ad0a-de32e7e036c7"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:35.442383 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6bb4f3ec-4ab1-4496-8639-52b906d0c3d8 tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 200 len: 1429 microversion: 2.1 time: 0.093984 Sep 15 00:56:35.444531 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 633/1280] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:35 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:35.448068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-28025487-cffc-46c6-9c9d-f6859dfdfa8a req-8c1175f9-224c-4da1-961a-6bc32ae96bc2 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:35.448550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-28025487-cffc-46c6-9c9d-f6859dfdfa8a req-8c1175f9-224c-4da1-961a-6bc32ae96bc2 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:35.448977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-28025487-cffc-46c6-9c9d-f6859dfdfa8a req-8c1175f9-224c-4da1-961a-6bc32ae96bc2 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:35.462959 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-28025487-cffc-46c6-9c9d-f6859dfdfa8a req-8c1175f9-224c-4da1-961a-6bc32ae96bc2 service nova] Creating event network-vif-deleted:d4024891-68b4-45cd-ad0a-de32e7e036c7 for instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 on hv-cinder-85752 Sep 15 00:56:35.469042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-28025487-cffc-46c6-9c9d-f6859dfdfa8a req-8c1175f9-224c-4da1-961a-6bc32ae96bc2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040469 Sep 15 00:56:35.469830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 648/1281] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:56:35.846745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:35.847353 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:35.853794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:35.854355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:35.854792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:35.855504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:35.855968 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:35.856392 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:35.985538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:35.993885 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-41cb1bbe-f542-4f64-9697-6e371f6735de tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.150976 Sep 15 00:56:35.994441 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 634/1282] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:35 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:36.466482 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:36.467337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] [instance: 7ed6407b-3728-48e9-aca1-c36a6e166a43] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:36.474401 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:36.474897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:36.475331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:36.476057 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:36.476509 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:36.476938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:36.490422 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] HTTP exception thrown: Instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 could not be found. Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Request method failure captured: Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 HTTP/1.1 Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjIngj3hGa98CeAl9VMvqA1l4UCPgUW_byI72LIcaHsl-6hJeXamdkO-L2gN0Uzoy_CdccJv6cmnNUHJNuf9pNxsi7y3B47jxj8QDKpnZheuoM8uaZeW5xEwuy5SXjtu26kydWhwzoJJg-PQNWDgK1J6d5HXGDkD_3ffgYA3ixslwpcuo Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 01d7d32119984a1aacc7109e74d9fe01 Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-VolumesNegativeTest-400147220 Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:56:36.492833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/01d7d32119984a1aacc7109e74d9fe01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_01d7d32119984a1aacc7109e74d9fe01", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/01d7d32119984a1aacc7109e74d9fe01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/01d7d32119984a1aacc7109e74d9fe01"}]}] Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-VolumesNegativeTest-400147220 Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 01d7d32119984a1aacc7109e74d9fe01 Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-VolumesNegativeTest-400147220 Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-VolumesNegativeTest-400147220-project Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 25addc94df284d82b633b3a29954507e Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-VolumesNegativeTest-400147220-project Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 could not be found. Sep 15 00:56:36.494540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '7ed6407b-3728-48e9-aca1-c36a6e166a43'} Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 could not be found. Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:56:36.495640 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 could not be found. Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 could not be found. Sep 15 00:56:36.497012 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:56:36.498226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] Returning 404 to user: Instance 7ed6407b-3728-48e9-aca1-c36a6e166a43 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:56:36.498226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-024d6770-b92a-4891-8fc5-5306b9cffd2e tempest-VolumesNegativeTest-400147220 tempest-VolumesNegativeTest-400147220-project] 10.222.0.15 "GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43" status: 404 len: 111 microversion: 2.1 time: 0.031990 Sep 15 00:56:36.498226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 649/1283] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:36 2022] GET /compute/v2.1/servers/7ed6407b-3728-48e9-aca1-c36a6e166a43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:56:37.016721 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:37.017344 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:37.024069 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:37.024566 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:37.025660 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:37.026378 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:37.026826 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:37.027259 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:37.173347 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:37.182831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c30f8e0e-1fe2-48fd-b2a8-a42609e4b670 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.170066 Sep 15 00:56:37.183562 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 635/1284] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:37 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:38.205952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:38.206566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:38.214457 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:38.214954 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:38.215390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:38.216128 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:38.216582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:38.217036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:38.371650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:38.380595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-5f748869-0f25-4a0e-ac01-68fcc440d712 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.178358 Sep 15 00:56:38.381424 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 650/1285] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:38 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:38.438597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-16483a11-f3f8-4faa-aea3-1f2f69e48e02 req-b4c4f351-38f2-433c-affb-2f5b14106ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c219172-398a-4d1a-b41b-a12948058ed4", "name": "network-vif-plugged", "status": "completed", "tag": "1e256011-f270-4453-bb18-eafb005e24f8"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:38.451427 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-16483a11-f3f8-4faa-aea3-1f2f69e48e02 req-b4c4f351-38f2-433c-affb-2f5b14106ed0 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:38.452180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-16483a11-f3f8-4faa-aea3-1f2f69e48e02 req-b4c4f351-38f2-433c-affb-2f5b14106ed0 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:38.453199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-16483a11-f3f8-4faa-aea3-1f2f69e48e02 req-b4c4f351-38f2-433c-affb-2f5b14106ed0 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:38.465242 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-16483a11-f3f8-4faa-aea3-1f2f69e48e02 req-b4c4f351-38f2-433c-affb-2f5b14106ed0 service nova] Creating event network-vif-plugged:1e256011-f270-4453-bb18-eafb005e24f8 for instance 3c219172-398a-4d1a-b41b-a12948058ed4 on hv-cinder-85752 Sep 15 00:56:38.470377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-16483a11-f3f8-4faa-aea3-1f2f69e48e02 req-b4c4f351-38f2-433c-affb-2f5b14106ed0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036473 Sep 15 00:56:38.471015 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 636/1286] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:56:39.405689 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:39.406298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:39.412658 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:39.413139 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:39.413573 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:39.414323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:39.414776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:39.415203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:39.433445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:39.549429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:39.557750 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-54bdf368-0be9-451f-aacc-f5b74dc5f784 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1263 microversion: 2.1 time: 0.156025 Sep 15 00:56:39.558320 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 651/1287] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:39 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:40.585902 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:40.586748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:40.599410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:40.600408 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:40.600994 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:40.602000 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:40.602575 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:40.603188 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:40.746270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:40.754343 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-033037c3-95c9-44a1-bef9-e3801cc31728 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1447 microversion: 2.1 time: 0.175137 Sep 15 00:56:40.755004 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 637/1288] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:40 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:40.777059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:56:40.777669 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:56:40.784122 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:40.784606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:40.785041 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:40.785748 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:40.786200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:40.786621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:40.925060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:56:40.932810 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-4027b161-e04d-4bee-9d9f-90393af09162 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1447 microversion: 2.1 time: 0.159531 Sep 15 00:56:40.933392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 652/1289] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:56:40 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:56:42.981841 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-f8f67660-ec28-4f78-a2ba-8c4e41f30c73 req-997a86c2-a188-43bd-8ee6-a464ebfbf425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c219172-398a-4d1a-b41b-a12948058ed4", "tag": "1e256011-f270-4453-bb18-eafb005e24f8"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:56:42.992422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f8f67660-ec28-4f78-a2ba-8c4e41f30c73 req-997a86c2-a188-43bd-8ee6-a464ebfbf425 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:56:42.992981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f8f67660-ec28-4f78-a2ba-8c4e41f30c73 req-997a86c2-a188-43bd-8ee6-a464ebfbf425 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:56:42.993478 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f8f67660-ec28-4f78-a2ba-8c4e41f30c73 req-997a86c2-a188-43bd-8ee6-a464ebfbf425 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:56:43.005403 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-f8f67660-ec28-4f78-a2ba-8c4e41f30c73 req-997a86c2-a188-43bd-8ee6-a464ebfbf425 service nova] Creating event network-changed:1e256011-f270-4453-bb18-eafb005e24f8 for instance 3c219172-398a-4d1a-b41b-a12948058ed4 on hv-cinder-85752 Sep 15 00:56:43.011312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-f8f67660-ec28-4f78-a2ba-8c4e41f30c73 req-997a86c2-a188-43bd-8ee6-a464ebfbf425 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033214 Sep 15 00:56:43.012722 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 638/1290] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:17.489684 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:17.490304 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:17.492576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:17.493286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=8 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:17.499332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:17.499842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:17.500275 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:17.501622 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:17.502076 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:17.502504 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:17.525488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-89f6ac61-3d5a-4d8e-a4de-26937675fe05 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f/ips" status: 200 len: 148 microversion: 2.1 time: 0.040300 Sep 15 00:57:17.526043 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 653/1291] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:57:17 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:17.539041 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:17.541745 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:17.544350 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=29 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:17.545210 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=73 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:17.553119 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:17.553656 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:17.554363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:17.554909 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:17.555370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:17.555933 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:17.638076 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Invalid volume: volume d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8 is already attached to instances: 6e47eda5-dffe-41dd-a09d-0870d19dd898 Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: POST /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f/os-volume_attachments HTTP/1.1 Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 74 Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:57:17.639939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {"volumeAttachment": {"volumeId": "d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8"}} Sep 15 00:57:17.641771 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Invalid volume: volume d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8 is already attached to instances: 6e47eda5-dffe-41dd-a09d-0870d19dd898 Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'server_id': '919d6f99-161e-4c7f-b7e8-2183095d5e1f', 'body': {'volumeAttachment': {'volumeId': 'd5e4bab6-9156-4b81-baff-d6c8f0a5d5d8'}}} Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8 is already attached to instances: 6e47eda5-dffe-41dd-a09d-0870d19dd898 Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:17.643098 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8 is already attached to instances: 6e47eda5-dffe-41dd-a09d-0870d19dd898 Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:17.644766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:17.647240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:17.647240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:57:17.647240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:57:17.647240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8 is already attached to instances: 6e47eda5-dffe-41dd-a09d-0870d19dd898 Sep 15 00:57:17.647240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:17.647240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 400 to user: Invalid volume: volume d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8 is already attached to instances: 6e47eda5-dffe-41dd-a09d-0870d19dd898 {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:57:17.647240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-291cca5d-2861-47a8-a318-69ac46245291 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106752 Sep 15 00:57:17.647240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 639/1292] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:57:17 2022] POST /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:57:17.650314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:17.650812 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:17.656823 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:17.657305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:17.657744 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:17.658435 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:17.658910 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:17.659364 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:17.687162 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:57:17.762606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8a3c634b-b93f-48a0-a294-0a85a73446c6 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 204 len: 0 microversion: 2.1 time: 0.115940 Sep 15 00:57:17.763196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 654/1293] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:57:17 2022] DELETE /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:57:17.772167 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:17.773067 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:17.785517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:17.786476 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:17.786924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:17.787692 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:17.788155 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:17.788641 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:17.917307 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:17.925635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e89a01f4-7329-4f6b-a5ac-780dac9309b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1678 microversion: 2.1 time: 0.157598 Sep 15 00:57:17.926212 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 640/1294] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:17 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:18.948884 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:18.949518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:18.956525 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:18.957010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:18.957446 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:18.958140 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:18.958595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:18.959019 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:19.087057 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:19.094633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2db49cc0-d6ae-44bf-92ec-a7d71acae1ee tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1678 microversion: 2.1 time: 0.150055 Sep 15 00:57:19.095194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 655/1295] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:18 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:20.118451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:20.119065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:20.125926 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:20.126439 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:20.126924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:20.127687 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:20.128184 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:20.128861 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:20.263986 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:20.271719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4c9d0c4e-832c-469b-b088-7348c497d452 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1678 microversion: 2.1 time: 0.157219 Sep 15 00:57:20.272300 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 641/1296] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:20 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:20.782642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-58ec4493-b316-4a33-b3cf-e2eef11a63ae req-c194e49d-5eac-4bff-92b8-06bde0dd5554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919d6f99-161e-4c7f-b7e8-2183095d5e1f", "name": "network-vif-deleted", "tag": "d96819c5-d122-476e-b592-f224863bf88c"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:20.793816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-58ec4493-b316-4a33-b3cf-e2eef11a63ae req-c194e49d-5eac-4bff-92b8-06bde0dd5554 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:20.794429 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-58ec4493-b316-4a33-b3cf-e2eef11a63ae req-c194e49d-5eac-4bff-92b8-06bde0dd5554 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:20.795001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-58ec4493-b316-4a33-b3cf-e2eef11a63ae req-c194e49d-5eac-4bff-92b8-06bde0dd5554 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:20.806733 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-58ec4493-b316-4a33-b3cf-e2eef11a63ae req-c194e49d-5eac-4bff-92b8-06bde0dd5554 service nova] Creating event network-vif-deleted:d96819c5-d122-476e-b592-f224863bf88c for instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f on hv-cinder-85752 Sep 15 00:57:20.811977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-58ec4493-b316-4a33-b3cf-e2eef11a63ae req-c194e49d-5eac-4bff-92b8-06bde0dd5554 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Sep 15 00:57:20.812638 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 656/1297] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:21.295317 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:21.295900 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:21.302885 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:21.303382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:21.303847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:21.304551 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:21.305008 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:21.305437 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:21.344939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:21.345597 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:21.346045 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:21.346570 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.objects.instance [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lazy-loading 'fault' on Instance uuid 919d6f99-161e-4c7f-b7e8-2183095d5e1f {{(pid=127200) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:57:21.392370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:21.400734 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2e2d4698-c70b-432e-a696-b0734ac473a5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 200 len: 1329 microversion: 2.1 time: 0.109321 Sep 15 00:57:21.401590 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 642/1298] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:21 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 1329 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:22.426589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:22.427288 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:22.433405 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:22.433889 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:22.434323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:22.435013 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:22.435465 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:22.435904 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:22.450252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f HTTP/1.1 Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:57:22.451869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 00:57:22.453541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '919d6f99-161e-4c7f-b7e8-2183095d5e1f'} Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:57:22.454513 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 00:57:22.456789 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:22.458253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:57:22.458253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-3fdef6e7-3af4-417f-9892-3ff5be3cc516 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 404 len: 111 microversion: 2.1 time: 0.031265 Sep 15 00:57:22.458253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 657/1299] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:22 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:57:22.462564 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e7e03fff-f551-4c29-9893-1ec89e12c403 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '.version_select at 0x7f2f207c2700>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:22.481363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e7e03fff-f551-4c29-9893-1ec89e12c403 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-458278090" status: 202 len: 0 microversion: 2.1 time: 0.022491 Sep 15 00:57:22.481964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 643/1300] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 00:57:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-458278090 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:57:23.151030 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:23.151555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:23.157589 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:23.158566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:23.159010 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:23.159720 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:23.160171 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:23.160594 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:23.245256 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lazy-loading 'services' on Instance uuid 6e47eda5-dffe-41dd-a09d-0870d19dd898 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:57:23.315502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bd1dcaef-1a7f-4353-8574-6fce06cc8fc3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-volume_attachments/d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8" status: 202 len: 0 microversion: 2.1 time: 0.168166 Sep 15 00:57:23.316131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 658/1301] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:57:23 2022] DELETE /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-volume_attachments/d5e4bab6-9156-4b81-baff-d6c8f0a5d5d8 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:57:23.325642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:23.330544 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:23.343352 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:23.343943 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:23.344392 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:23.345230 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:23.346186 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:23.346620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:23.381891 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-cd8da1f1-6c0d-493e-92a4-ece3c5bd552f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061192 Sep 15 00:57:23.382451 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 644/1302] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:57:23 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:24.395326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:24.397716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:24.403926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:24.404448 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:24.404822 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:24.405522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:24.405971 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:24.406394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:24.434734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-091868d2-561b-43e6-981d-98daf60ead0c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044266 Sep 15 00:57:24.435280 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 659/1303] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:57:24 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 00:57:24.499226 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:24.499767 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:24.507024 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:24.507538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:24.507981 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:24.508677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:24.509128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:24.509553 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:24.534426 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:57:24.613205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-380ad1d9-c9db-4582-8cf0-b2c21b1c1494 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 204 len: 0 microversion: 2.1 time: 0.117002 Sep 15 00:57:24.614585 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 645/1304] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:57:24 2022] DELETE /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:57:24.624631 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:24.625396 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:24.631760 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:24.632245 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:24.632713 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:24.633408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:24.633920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:24.634289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:24.765962 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:24.773641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-acdc9f21-2271-446b-be87-533dffa23f9b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1681 microversion: 2.1 time: 0.154778 Sep 15 00:57:24.774196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 660/1305] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:24 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:25.798053 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:25.798766 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:25.805960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:25.806713 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:25.807159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:25.807893 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:25.808354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:25.808783 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:25.942542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:25.950321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-54fcf781-7ee5-4f99-9665-600c3d2a776f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1681 microversion: 2.1 time: 0.156586 Sep 15 00:57:25.950895 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 646/1306] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:25 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:26.973308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:26.973927 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:26.980431 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:26.980911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:26.981351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:26.982051 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:26.982503 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:26.982929 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:27.168880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:27.177660 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fe965bef-1daa-496c-81f1-4f58ed8fbe4f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1681 microversion: 2.1 time: 0.208183 Sep 15 00:57:27.178242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 661/1307] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:26 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:27.702401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-4e37f506-e10c-4807-a491-133491a678ae req-ac4276a6-e835-4ccb-bad8-fc6d00fe2099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e47eda5-dffe-41dd-a09d-0870d19dd898", "name": "network-vif-deleted", "tag": "4cd61e51-9091-42e2-b4f8-f67dbf137235"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:27.712323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-4e37f506-e10c-4807-a491-133491a678ae req-ac4276a6-e835-4ccb-bad8-fc6d00fe2099 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:27.712807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-4e37f506-e10c-4807-a491-133491a678ae req-ac4276a6-e835-4ccb-bad8-fc6d00fe2099 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:27.713272 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-4e37f506-e10c-4807-a491-133491a678ae req-ac4276a6-e835-4ccb-bad8-fc6d00fe2099 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:27.726087 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-4e37f506-e10c-4807-a491-133491a678ae req-ac4276a6-e835-4ccb-bad8-fc6d00fe2099 service nova] Creating event network-vif-deleted:4cd61e51-9091-42e2-b4f8-f67dbf137235 for instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 on hv-cinder-85752 Sep 15 00:57:27.731760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-4e37f506-e10c-4807-a491-133491a678ae req-ac4276a6-e835-4ccb-bad8-fc6d00fe2099 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Sep 15 00:57:27.732658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 647/1308] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:28.201926 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:28.203205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:28.210253 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:28.210751 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:28.211188 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:28.211928 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:28.212709 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:28.212856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:28.244577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:28.245073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:28.245518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:28.245969 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lazy-loading 'fault' on Instance uuid 6e47eda5-dffe-41dd-a09d-0870d19dd898 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:57:28.290692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:28.298866 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-06a24344-d806-4cbe-a2b4-1bf282531bb5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 200 len: 1331 microversion: 2.1 time: 0.100751 Sep 15 00:57:28.299556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 662/1309] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:28 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:29.323815 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:29.324508 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:29.330792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:29.331306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:29.331794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:29.332529 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:29.333003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:29.333447 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:29.346894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 HTTP/1.1 Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:57:29.348574 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 00:57:29.350567 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '6e47eda5-dffe-41dd-a09d-0870d19dd898'} Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:57:29.351958 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 00:57:29.353924 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:29.355679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:57:29.355679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0cf26084-9df5-4170-aa34-7a8ee4883541 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 404 len: 111 microversion: 2.1 time: 0.031023 Sep 15 00:57:29.355679 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 648/1310] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:29 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:57:29.358999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e3de5970-5e8a-45ae-a535-9b1591a78acc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '.version_select at 0x7f2f1cf6e5e0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:29.378321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e3de5970-5e8a-45ae-a535-9b1591a78acc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553343496" status: 202 len: 0 microversion: 2.1 time: 0.023236 Sep 15 00:57:29.379198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 663/1311] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 00:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553343496 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:57:29.990642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-2f061ff7-c0b8-4eb9-a7c1-ba0057479564 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: .version_select at 0x7f2f207d69d0>, body: {"keypair": {"name": "tempest-keypair-1680558882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgu5SNkbLlGqQxDpNRZBieLAmZCLaxbzyxoeYeY7Uz4heJLY18EN1NbohuNvUHnBryxtkR4+jqXcAARTi4PQH9MVQlLQoKF2L86U932Fy82PsP/rB/bd7ixjHSimkBEFg=="}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:30.006552 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-2f061ff7-c0b8-4eb9-a7c1-ba0057479564 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:57:30.010549 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-2f061ff7-c0b8-4eb9-a7c1-ba0057479564 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for user 778fc9ee164e46a9b874dd0e20d38392 and project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:57:30.031462 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-2f061ff7-c0b8-4eb9-a7c1-ba0057479564 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044859 Sep 15 00:57:30.032059 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 649/1312] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:57:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:31.305663 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1601217171", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48f46f03-9920-4d15-b1d4-ea751486aaae"}], "security_groups": [{"name": "tempest-securitygroup--747034152"}], "key_name": "tempest-keypair-1680558882", "user_data": "}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:31.409080 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] validate_networks() for [('48f46f03-9920-4d15-b1d4-ea751486aaae', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:57:31.892289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:57:31.892716 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:57:31.893187 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:57:31.893595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:57:31.894009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:57:31.902626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:31.903102 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:31.903563 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:31.904293 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:31.904768 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:31.905192 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:31.922131 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:57:31.926479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for user 778fc9ee164e46a9b874dd0e20d38392 and project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:57:31.937198 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:57:31.939472 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:57:31.988574 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-052b6a77-1966-4757-bbbf-b10f0cd85285 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.687749 Sep 15 00:57:31.989220 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 664/1313] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:57:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 00:57:32.001234 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-581e66dd-ee33-404a-bdb8-fe8e182a54be tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:32.002422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-581e66dd-ee33-404a-bdb8-fe8e182a54be tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:32.060932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-581e66dd-ee33-404a-bdb8-fe8e182a54be tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:32.068490 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-581e66dd-ee33-404a-bdb8-fe8e182a54be tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1242 microversion: 2.1 time: 0.071721 Sep 15 00:57:32.069287 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 650/1314] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:31 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:57:33.091402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:33.092036 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:33.099203 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:33.099725 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:33.100164 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:33.100931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:33.101380 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:33.101922 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:33.195870 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:33.204432 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-dcd466b9-c191-4d21-bcc7-528a76db99ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1302 microversion: 2.1 time: 0.116875 Sep 15 00:57:33.205013 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 665/1315] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:33 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:34.228964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:34.229790 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:34.236286 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:34.237275 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:34.238033 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:34.238447 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:34.239221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:34.239854 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:34.376294 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:34.385510 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-dab8ca58-e3bc-4d87-8fe3-953068251e34 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1367 microversion: 2.1 time: 0.160415 Sep 15 00:57:34.386310 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 651/1316] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:34 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:34.599772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-c97eb3ea-fc88-46ee-a8c5-b834e5c4bdb3 req-dda62985-9fc5-484b-8c24-9aa490fbd7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d91d915-a936-4f20-b538-f3b050a2e61d", "tag": "e800a621-1394-4d38-a779-6ed9ffbdca43"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:34.610608 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c97eb3ea-fc88-46ee-a8c5-b834e5c4bdb3 req-dda62985-9fc5-484b-8c24-9aa490fbd7de service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:34.611094 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c97eb3ea-fc88-46ee-a8c5-b834e5c4bdb3 req-dda62985-9fc5-484b-8c24-9aa490fbd7de service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:34.611555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-c97eb3ea-fc88-46ee-a8c5-b834e5c4bdb3 req-dda62985-9fc5-484b-8c24-9aa490fbd7de service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:34.623157 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-c97eb3ea-fc88-46ee-a8c5-b834e5c4bdb3 req-dda62985-9fc5-484b-8c24-9aa490fbd7de service nova] Creating event network-changed:e800a621-1394-4d38-a779-6ed9ffbdca43 for instance 8d91d915-a936-4f20-b538-f3b050a2e61d on hv-cinder-85752 Sep 15 00:57:34.628011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-c97eb3ea-fc88-46ee-a8c5-b834e5c4bdb3 req-dda62985-9fc5-484b-8c24-9aa490fbd7de service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033259 Sep 15 00:57:34.628595 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 666/1317] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:35.409199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:35.409787 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:35.416312 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:35.416794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:35.417227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:35.417914 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:35.418365 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:35.418786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:35.547409 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:35.555453 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-254a76fd-5174-428b-9729-5f5b073ac240 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1367 microversion: 2.1 time: 0.150297 Sep 15 00:57:35.556037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 652/1318] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:35 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:36.579609 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:36.580315 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:36.587111 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:36.587633 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:36.588073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:36.588772 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:36.589234 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:36.589664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:36.719543 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:36.727261 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9b22bf9f-3a34-4b10-b53c-d5c54a232e02 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1367 microversion: 2.1 time: 0.152361 Sep 15 00:57:36.727861 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 667/1319] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:36 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:37.749830 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:37.750471 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:37.757827 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:37.758303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:37.758741 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:37.759427 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:37.759908 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:37.760329 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:37.889331 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:37.896862 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-c6d23322-d252-45ae-8314-758f9fdc87da tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1367 microversion: 2.1 time: 0.151006 Sep 15 00:57:37.897422 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 653/1320] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:37 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:38.918576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:38.919202 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:38.926388 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:38.926882 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:38.927323 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:38.928075 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:38.928836 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:38.929008 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:39.060132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:39.068641 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-71dbd180-4339-473f-84ce-7c6a29a5c2ed tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1367 microversion: 2.1 time: 0.153913 Sep 15 00:57:39.069217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 668/1321] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:38 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:39.227369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:39.229802 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:39.236495 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:39.237244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:39.238183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:39.238901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:39.239357 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:39.239820 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:39.274040 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6e0e1fbd-9c80-4820-b2d5-b3d11e4f1155 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050239 Sep 15 00:57:39.274964 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 654/1322] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 15 00:57:39 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:39.338295 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:39.338796 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:39.344627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:39.345115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:39.345560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:39.346286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:39.346745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:39.347205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:39.374178 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:57:39.408978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:39.458692 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b0833441-120c-4fbb-a3bc-ab4926586136 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 204 len: 0 microversion: 2.20 time: 0.123903 Sep 15 00:57:39.459386 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 669/1323] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 15 00:57:39 2022] DELETE /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 00:57:39.467764 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:39.468375 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:39.474742 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:39.475227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:39.475693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:39.476381 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:39.476831 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:39.477251 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:39.601355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:39.609414 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:39.610844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:39.612065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-aa620ef2-5069-4757-b228-194dfe3deda7 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.148216 Sep 15 00:57:39.612619 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 655/1324] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:57:39 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:57:40.090905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:40.091663 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:40.098674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:40.099154 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:40.099628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:40.100326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:40.100776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:40.101197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:40.240294 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:40.247842 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-667507d3-a85b-4e58-8fd9-b8859ea8c55c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1367 microversion: 2.1 time: 0.161121 Sep 15 00:57:40.248408 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 670/1325] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:40 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:40.636198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-f036601d-741e-4dae-8962-91df20c6e82e req-8c80bd02-42bb-4771-b20c-b1083a08166a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d91d915-a936-4f20-b538-f3b050a2e61d", "name": "network-vif-plugged", "status": "completed", "tag": "e800a621-1394-4d38-a779-6ed9ffbdca43"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:40.642230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:40.642884 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:40.646698 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f036601d-741e-4dae-8962-91df20c6e82e req-8c80bd02-42bb-4771-b20c-b1083a08166a service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:40.647171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f036601d-741e-4dae-8962-91df20c6e82e req-8c80bd02-42bb-4771-b20c-b1083a08166a service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:40.647653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f036601d-741e-4dae-8962-91df20c6e82e req-8c80bd02-42bb-4771-b20c-b1083a08166a service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:40.649688 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:40.650212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:40.650674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:40.651414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:40.651968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:40.652343 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:40.660454 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-f036601d-741e-4dae-8962-91df20c6e82e req-8c80bd02-42bb-4771-b20c-b1083a08166a service nova] Creating event network-vif-plugged:e800a621-1394-4d38-a779-6ed9ffbdca43 for instance 8d91d915-a936-4f20-b538-f3b050a2e61d on hv-cinder-85752 Sep 15 00:57:40.665398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-f036601d-741e-4dae-8962-91df20c6e82e req-8c80bd02-42bb-4771-b20c-b1083a08166a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032904 Sep 15 00:57:40.666303 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 656/1326] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:40.780189 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:40.788321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:40.789765 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:40.790931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-12d1129b-4382-4a60-a8ca-fbab82055037 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.152639 Sep 15 00:57:40.791518 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 671/1327] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:57:40 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:57:41.272077 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:41.272788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:41.279014 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:41.279523 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:41.279970 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:41.280676 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:41.281136 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:41.281589 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:41.408399 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:41.416051 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0b242799-da0f-4df3-b7f2-df25147cbef1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1367 microversion: 2.1 time: 0.148807 Sep 15 00:57:41.416626 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 657/1328] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:41 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:41.819410 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:41.820049 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:41.826458 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:41.826940 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:41.827379 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:41.828102 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:41.828559 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:41.828988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:41.911146 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:41.932838 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:41.955968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:41.965184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:41.966628 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:41.967830 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8178a9f8-0100-4452-88c1-a34ec6e7326f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1723 microversion: 2.20 time: 0.153251 Sep 15 00:57:41.968402 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 672/1329] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:57:41 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:57:42.440657 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:42.442127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:42.444966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=6 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:42.450363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:42.450845 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:42.451279 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:42.452005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:42.452456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:42.452995 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:42.471274 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:42.594016 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:42.602642 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-26158d6c-0b6f-41a8-93b0-cd325241b0b8 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1367 microversion: 2.1 time: 0.165950 Sep 15 00:57:42.603236 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 658/1330] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:42 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:42.992955 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:42.994157 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:43.001248 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:43.001931 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:43.002646 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:43.003298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:43.003776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:43.004462 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:43.086599 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:43.094936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:43.096415 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e8e45674624c219b59abb39d8dcf83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d7dfe402c045edbca04c0e7eee05f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:43.097663 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-accee803-0216-4d80-82a9-5da82cea9201 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 200 len: 1656 microversion: 2.20 time: 0.108654 Sep 15 00:57:43.098227 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 673/1331] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:57:42 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 1656 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 00:57:43.310922 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-f6316fca-6b21-448d-95c7-833a1c474115 req-0629c327-4c09-4a85-b581-1f3494296c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c270acf-24d9-4d2e-bf97-2f487bd44a96", "name": "network-vif-deleted", "tag": "9e2fa835-2b12-4126-9efe-5387a46e4c0c"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:43.321191 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f6316fca-6b21-448d-95c7-833a1c474115 req-0629c327-4c09-4a85-b581-1f3494296c5c service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:43.321919 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f6316fca-6b21-448d-95c7-833a1c474115 req-0629c327-4c09-4a85-b581-1f3494296c5c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:43.322474 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-f6316fca-6b21-448d-95c7-833a1c474115 req-0629c327-4c09-4a85-b581-1f3494296c5c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:43.339921 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-f6316fca-6b21-448d-95c7-833a1c474115 req-0629c327-4c09-4a85-b581-1f3494296c5c service nova] Creating event network-vif-deleted:9e2fa835-2b12-4126-9efe-5387a46e4c0c for instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 on hv-cinder-85752 Sep 15 00:57:43.345694 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-f6316fca-6b21-448d-95c7-833a1c474115 req-0629c327-4c09-4a85-b581-1f3494296c5c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038059 Sep 15 00:57:43.347410 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 659/1332] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:43.625843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:43.626816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:43.633205 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:43.633916 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:43.634351 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:43.635229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:43.635878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:43.636469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:43.771852 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:57:43.779687 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-fc0622f3-58e1-46f3-af54-93f5f8bcb12d tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1556 microversion: 2.1 time: 0.157573 Sep 15 00:57:43.780550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 674/1333] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:57:43 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:57:43.803276 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:43.803990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:43.810622 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:43.811107 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:43.811637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:43.812503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:43.812960 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:43.813389 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:43.891693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-bb603c9c-ac0b-4268-b2f2-729ee0db0ccb tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093025 Sep 15 00:57:43.892518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 660/1334] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 00:57:43 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:44.124355 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:44.125115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:44.132049 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:44.132721 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:44.133204 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:44.134011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:44.134565 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:44.135105 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:44.148923 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] HTTP exception thrown: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Request method failure captured: Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 HTTP/1.1 Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInYB2mhtQqxcB1QREGjisNPQk6LTwf4voc_jcXMpNSHSSUVNzDzJoyQDYY8vSNBnep78M9nl6h20vnyLd8ZWjYbVhylXCFwH_UQwmdB9dFs0Qlo6_no3CNjN0zAj2aTc6ky21QZLTahcNwm4t9Z5EcrCRDhIoDCkZjKa__MdSSJKXq0 Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:57:44.150673 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_72d7dfe402c045edbca04c0e7eee05f9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/72d7dfe402c045edbca04c0e7eee05f9"}]}] Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 36e8e45674624c219b59abb39d8dcf83 Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:44.152455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '4c270acf-24d9-4d2e-bf97-2f487bd44a96'} Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:57:44.153437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:44.158366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:44.160222 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Returning 404 to user: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:57:44.160222 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-262f01b8-1ff9-48a6-8ff2-001555b8769c tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 404 len: 111 microversion: 2.20 time: 0.033067 Sep 15 00:57:44.160222 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 675/1335] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:57:44 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:57:44.163443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-935a77db-3fb0-426d-a59f-635020639204 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '.version_select at 0x7f2f1d1ee670>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:44.185429 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-935a77db-3fb0-426d-a59f-635020639204 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766892730" status: 204 len: 0 microversion: 2.20 time: 0.026514 Sep 15 00:57:44.186219 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 661/1336] 10.222.0.15 () {60 vars in 1259 bytes} [Thu Sep 15 00:57:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766892730 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 00:57:45.363388 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-7f794bdf-ad20-423c-8b49-ad909aafa90c req-6c26d5b0-dfa8-4d1d-8e8f-9d03b435684f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d91d915-a936-4f20-b538-f3b050a2e61d", "tag": "e800a621-1394-4d38-a779-6ed9ffbdca43"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:57:45.373317 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7f794bdf-ad20-423c-8b49-ad909aafa90c req-6c26d5b0-dfa8-4d1d-8e8f-9d03b435684f service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:45.373833 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7f794bdf-ad20-423c-8b49-ad909aafa90c req-6c26d5b0-dfa8-4d1d-8e8f-9d03b435684f service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:45.374258 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-7f794bdf-ad20-423c-8b49-ad909aafa90c req-6c26d5b0-dfa8-4d1d-8e8f-9d03b435684f service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:45.387671 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-7f794bdf-ad20-423c-8b49-ad909aafa90c req-6c26d5b0-dfa8-4d1d-8e8f-9d03b435684f service nova] Creating event network-changed:e800a621-1394-4d38-a779-6ed9ffbdca43 for instance 8d91d915-a936-4f20-b538-f3b050a2e61d on hv-cinder-85752 Sep 15 00:57:45.392476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-7f794bdf-ad20-423c-8b49-ad909aafa90c req-6c26d5b0-dfa8-4d1d-8e8f-9d03b435684f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034084 Sep 15 00:57:45.393064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 676/1337] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:57:45.999397 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:45.999939 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:46.006251 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:46.006719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:46.007172 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:46.007894 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:46.008354 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:46.008832 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:46.022726 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] HTTP exception thrown: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Request method failure captured: Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: DELETE /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 HTTP/1.1 Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInYB2mhtQqxcB1QREGjisNPQk6LTwf4voc_jcXMpNSHSSUVNzDzJoyQDYY8vSNBnep78M9nl6h20vnyLd8ZWjYbVhylXCFwH_UQwmdB9dFs0Qlo6_no3CNjN0zAj2aTc6ky21QZLTahcNwm4t9Z5EcrCRDhIoDCkZjKa__MdSSJKXq0 Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:57:46.024443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_72d7dfe402c045edbca04c0e7eee05f9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/72d7dfe402c045edbca04c0e7eee05f9"}]}] Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 36e8e45674624c219b59abb39d8dcf83 Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.026363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '4c270acf-24d9-4d2e-bf97-2f487bd44a96'} Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:57:46.027416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.028881 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.030592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Returning 404 to user: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:57:46.030592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-ab989164-8378-4792-831b-1c96e119b40f tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 404 len: 111 microversion: 2.20 time: 0.030944 Sep 15 00:57:46.030592 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 662/1338] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 15 00:57:45 2022] DELETE /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:57:46.035560 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:46.036270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 4c270acf-24d9-4d2e-bf97-2f487bd44a96] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:46.042442 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:46.042935 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:46.043377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:46.044115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:46.044571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:46.045002 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:46.057968 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] HTTP exception thrown: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Request method failure captured: Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 HTTP/1.1 Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInYB2mhtQqxcB1QREGjisNPQk6LTwf4voc_jcXMpNSHSSUVNzDzJoyQDYY8vSNBnep78M9nl6h20vnyLd8ZWjYbVhylXCFwH_UQwmdB9dFs0Qlo6_no3CNjN0zAj2aTc6ky21QZLTahcNwm4t9Z5EcrCRDhIoDCkZjKa__MdSSJKXq0 Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:57:46.059627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_72d7dfe402c045edbca04c0e7eee05f9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/72d7dfe402c045edbca04c0e7eee05f9"}]}] Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 36e8e45674624c219b59abb39d8dcf83 Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.061384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '4c270acf-24d9-4d2e-bf97-2f487bd44a96'} Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:57:46.062392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. Sep 15 00:57:46.064009 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:46.065524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Returning 404 to user: Instance 4c270acf-24d9-4d2e-bf97-2f487bd44a96 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:57:46.065524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-2a377b06-8529-47cf-ac16-5d11d861d7e3 tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96" status: 404 len: 111 microversion: 2.20 time: 0.030352 Sep 15 00:57:46.065524 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 677/1339] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:57:46 2022] GET /compute/v2.1/servers/4c270acf-24d9-4d2e-bf97-2f487bd44a96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 00:57:47.200738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:47.203323 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:47.212697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:47.213180 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:47.213615 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:47.214321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:47.214772 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:47.215194 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:47.228418 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] HTTP exception thrown: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Request method failure captured: Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: DELETE /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 HTTP/1.1 Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInYB2mhtQqxcB1QREGjisNPQk6LTwf4voc_jcXMpNSHSSUVNzDzJoyQDYY8vSNBnep78M9nl6h20vnyLd8ZWjYbVhylXCFwH_UQwmdB9dFs0Qlo6_no3CNjN0zAj2aTc6ky21QZLTahcNwm4t9Z5EcrCRDhIoDCkZjKa__MdSSJKXq0 Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:57:47.229969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_72d7dfe402c045edbca04c0e7eee05f9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/72d7dfe402c045edbca04c0e7eee05f9"}]}] Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 36e8e45674624c219b59abb39d8dcf83 Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.231729 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '469fcc1e-0231-4642-b72f-c2bf7fd7eb07'} Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:57:47.232691 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.234233 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.235844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Returning 404 to user: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:57:47.235844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e0e33f44-aa53-42b9-a120-c39ca0a1312e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "DELETE /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 404 len: 111 microversion: 2.20 time: 0.036578 Sep 15 00:57:47.235844 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 663/1340] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 15 00:57:47 2022] DELETE /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:57:47.239880 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:57:47.240502 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] [instance: 469fcc1e-0231-4642-b72f-c2bf7fd7eb07] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:57:47.246908 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:47.247399 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:47.247874 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:47.248577 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:57:47.249039 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:57:47.249469 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:57:47.263335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] HTTP exception thrown: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Request method failure captured: Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 HTTP/1.1 Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInYB2mhtQqxcB1QREGjisNPQk6LTwf4voc_jcXMpNSHSSUVNzDzJoyQDYY8vSNBnep78M9nl6h20vnyLd8ZWjYbVhylXCFwH_UQwmdB9dFs0Qlo6_no3CNjN0zAj2aTc6ky21QZLTahcNwm4t9Z5EcrCRDhIoDCkZjKa__MdSSJKXq0 Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:57:47.264903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_72d7dfe402c045edbca04c0e7eee05f9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/72d7dfe402c045edbca04c0e7eee05f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/72d7dfe402c045edbca04c0e7eee05f9"}]}] Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 72d7dfe402c045edbca04c0e7eee05f9 Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1795963454 Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 36e8e45674624c219b59abb39d8dcf83 Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1795963454-project Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.266619 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '469fcc1e-0231-4642-b72f-c2bf7fd7eb07'} Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:57:47.267784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. Sep 15 00:57:47.270016 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:57:47.271455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] Returning 404 to user: Instance 469fcc1e-0231-4642-b72f-c2bf7fd7eb07 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:57:47.271455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7f2a6411-53bd-4dbb-a1cb-72c172abf78e tempest-AttachVolumeShelveTestJSON-1795963454 tempest-AttachVolumeShelveTestJSON-1795963454-project] 10.222.0.15 "GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07" status: 404 len: 111 microversion: 2.20 time: 0.030266 Sep 15 00:57:47.271455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 678/1341] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 15 00:57:47 2022] GET /compute/v2.1/servers/469fcc1e-0231-4642-b72f-c2bf7fd7eb07 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 00:58:58.610984 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:58.612730 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:58.613036 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:58:58.613792 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:58:58.620306 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:58.620982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=12 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:58.622734 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 15 00:58:58.623211 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-2575c4fa-2e80-4568-ab34-84e588930eef req-210a832f-6669-42e8-b323-7a21e8cbd8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c219172-398a-4d1a-b41b-a12948058ed4", "tag": "1e256011-f270-4453-bb18-eafb005e24f8"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:58:58.625628 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:58:58.626110 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:58:58.626920 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:58:58.627253 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:58:58.627736 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:58:58.628161 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:58:58.638221 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2575c4fa-2e80-4568-ab34-84e588930eef req-210a832f-6669-42e8-b323-7a21e8cbd8d3 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:58:58.639080 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2575c4fa-2e80-4568-ab34-84e588930eef req-210a832f-6669-42e8-b323-7a21e8cbd8d3 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:58:58.640020 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-2575c4fa-2e80-4568-ab34-84e588930eef req-210a832f-6669-42e8-b323-7a21e8cbd8d3 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:58:58.657264 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-2575c4fa-2e80-4568-ab34-84e588930eef req-210a832f-6669-42e8-b323-7a21e8cbd8d3 service nova] Creating event network-changed:1e256011-f270-4453-bb18-eafb005e24f8 for instance 3c219172-398a-4d1a-b41b-a12948058ed4 on hv-cinder-85752 Sep 15 00:58:58.662550 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-2575c4fa-2e80-4568-ab34-84e588930eef req-210a832f-6669-42e8-b323-7a21e8cbd8d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053576 Sep 15 00:58:58.663979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 679/1342] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:58:58.665596 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:58:58.749738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-eca88fa5-2db9-4b50-ae87-76fbcd374d73 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 204 len: 0 microversion: 2.1 time: 0.140942 Sep 15 00:58:58.752258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 664/1343] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:58:58 2022] DELETE /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:58:58.759829 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:58:58.760539 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:58:58.766793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:58:58.767289 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:58:58.767805 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:58:58.768496 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:58:58.768957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:58:58.769395 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:58:58.900444 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:58:58.908341 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-252b6d91-0c3d-4b1b-b3a4-23aa49272824 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1572 microversion: 2.1 time: 0.153399 Sep 15 00:58:58.908911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 680/1344] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:58:58 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:58:59.933144 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:58:59.933849 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:58:59.947147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:58:59.947690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:58:59.948135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:58:59.948864 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:58:59.949331 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:58:59.949757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:00.142738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:00.143572 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:00.145936 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:00.150092 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:00.150614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:00.151047 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:00.151782 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:00.152244 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:00.152669 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:00.154007 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-0153ebb3-88f0-4554-ae25-f0737ea1a5e4 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1572 microversion: 2.1 time: 0.225952 Sep 15 00:59:00.154572 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 681/1345] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:58:59 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1572 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:59:00.176107 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8f7c57bd-0013-477d-ac6f-ac548de62a13 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/ips" status: 200 len: 149 microversion: 2.1 time: 0.268524 Sep 15 00:59:00.176572 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 665/1346] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 00:58:59 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/ips => generated 149 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:59:01.177576 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:01.178134 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:01.185626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:01.186120 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:01.186561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:01.187312 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:01.187872 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:01.188301 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:01.467144 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:01.475242 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d3792f48-418d-4729-89fc-1624492d51dc tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1453 microversion: 2.1 time: 0.301696 Sep 15 00:59:01.476196 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 682/1347] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:01 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1453 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:01.519178 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "836c8f8f-f8cf-4eaa-8738-2f2439abd290"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:01.521685 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:01.528174 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:01.528671 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:01.529158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:01.529824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:01.530290 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:01.530723 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:01.695366 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-69284d47-64e3-4d32-9a7e-a4c95f5ca869 req-d0b616a0-66d2-4ed4-9ad3-5d935d4dfc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c219172-398a-4d1a-b41b-a12948058ed4", "name": "network-vif-deleted", "tag": "1e256011-f270-4453-bb18-eafb005e24f8"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:01.708778 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-69284d47-64e3-4d32-9a7e-a4c95f5ca869 req-d0b616a0-66d2-4ed4-9ad3-5d935d4dfc9c service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:01.709352 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-69284d47-64e3-4d32-9a7e-a4c95f5ca869 req-d0b616a0-66d2-4ed4-9ad3-5d935d4dfc9c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:01.709873 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-69284d47-64e3-4d32-9a7e-a4c95f5ca869 req-d0b616a0-66d2-4ed4-9ad3-5d935d4dfc9c service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:01.722878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-69284d47-64e3-4d32-9a7e-a4c95f5ca869 req-d0b616a0-66d2-4ed4-9ad3-5d935d4dfc9c service nova] Creating event network-vif-deleted:1e256011-f270-4453-bb18-eafb005e24f8 for instance 3c219172-398a-4d1a-b41b-a12948058ed4 on hv-cinder-85752 Sep 15 00:59:01.728533 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-69284d47-64e3-4d32-9a7e-a4c95f5ca869 req-d0b616a0-66d2-4ed4-9ad3-5d935d4dfc9c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037403 Sep 15 00:59:01.729175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 683/1348] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:59:01.806469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-e1b7e4e0-3d6d-4b2f-af6e-2f40362689dc tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290926 Sep 15 00:59:01.807080 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 666/1349] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:59:01 2022] POST /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:59:02.499677 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:02.500297 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:02.506626 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:02.507734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:02.508176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:02.508876 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:02.509335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:02.509764 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:02.541920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:02.542414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:02.542854 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:02.543307 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lazy-loading 'fault' on Instance uuid 3c219172-398a-4d1a-b41b-a12948058ed4 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:59:02.591621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:02.600259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-044920f1-d9ac-4bd9-b6f6-97bae474b1e5 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 200 len: 1228 microversion: 2.1 time: 0.105388 Sep 15 00:59:02.615664 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 684/1350] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:02 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 1228 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:03.626427 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:03.627018 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 3c219172-398a-4d1a-b41b-a12948058ed4] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:03.635256 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:03.635770 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:03.636250 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:03.636923 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:03.637382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:03.637813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:03.655171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] HTTP exception thrown: Instance 3c219172-398a-4d1a-b41b-a12948058ed4 could not be found. Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Request method failure captured: Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 HTTP/1.1 Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInaDE_ROE34nHoRQmFXLIGCxGhmBDzx5igFLmHnB1uUoKzc_sN65y5Txyztrv7sCTkysb0cj3NzFWv7x6MgNnOVMPdnFAjOwhu7CYUbSNr-_h-eG1lQHZgPYTJwtBKAlUN9QxLKYIjVuHoQVddGJYUiGTKEcOvpI6h2kqlFs_HNpP8g Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:59:03.656860 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_53d8d76185c44a159439c0f7a0e88b31", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/53d8d76185c44a159439c0f7a0e88b31"}]}] Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: d308262224af475091e6aa494ea839b1 Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 3c219172-398a-4d1a-b41b-a12948058ed4 could not be found. Sep 15 00:59:03.658500 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '3c219172-398a-4d1a-b41b-a12948058ed4'} Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c219172-398a-4d1a-b41b-a12948058ed4 could not be found. Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:59:03.660990 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c219172-398a-4d1a-b41b-a12948058ed4 could not be found. Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c219172-398a-4d1a-b41b-a12948058ed4 could not be found. Sep 15 00:59:03.663056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:03.664527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Returning 404 to user: Instance 3c219172-398a-4d1a-b41b-a12948058ed4 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:59:03.664527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-051c5780-d50d-4887-9c93-ffc811490634 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4" status: 404 len: 111 microversion: 2.1 time: 0.036384 Sep 15 00:59:03.664527 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 667/1351] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:03 2022] GET /compute/v2.1/servers/3c219172-398a-4d1a-b41b-a12948058ed4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 00:59:06.701668 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-4e380f8c-79ef-4ca5-a2ae-2ad717b9ce47 req-a85b22ab-a63f-4dc1-b90a-2d34c4219e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c770ee1-1cc8-4af3-bb2c-ab3753156e37", "tag": "d1b21f4d-7863-4a9c-ac7d-ae028778c2c8"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:06.709310 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:06.709869 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:06.714520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-4e380f8c-79ef-4ca5-a2ae-2ad717b9ce47 req-a85b22ab-a63f-4dc1-b90a-2d34c4219e53 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:06.715003 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-4e380f8c-79ef-4ca5-a2ae-2ad717b9ce47 req-a85b22ab-a63f-4dc1-b90a-2d34c4219e53 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:06.715438 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-4e380f8c-79ef-4ca5-a2ae-2ad717b9ce47 req-a85b22ab-a63f-4dc1-b90a-2d34c4219e53 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:06.716900 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:06.717390 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:06.717828 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:06.718535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:06.719003 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:06.719436 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:06.727520 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-4e380f8c-79ef-4ca5-a2ae-2ad717b9ce47 req-a85b22ab-a63f-4dc1-b90a-2d34c4219e53 service nova] Creating event network-changed:d1b21f4d-7863-4a9c-ac7d-ae028778c2c8 for instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 on hv-cinder-85752 Sep 15 00:59:06.733044 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-4e380f8c-79ef-4ca5-a2ae-2ad717b9ce47 req-a85b22ab-a63f-4dc1-b90a-2d34c4219e53 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034880 Sep 15 00:59:06.734182 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 668/1352] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:59:06.746046 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:59:06.826979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-33f844ca-e26d-4752-a55d-5c585cf44252 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 204 len: 0 microversion: 2.1 time: 0.132612 Sep 15 00:59:06.827745 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 685/1353] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:59:06 2022] DELETE /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 00:59:06.837382 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:06.838085 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:06.847321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:06.847847 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:06.848284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:06.849240 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:06.850969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:06.851873 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:06.986115 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:06.994511 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-72361108-a195-4cf6-b4e9-0637f61841a0 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1575 microversion: 2.1 time: 0.161942 Sep 15 00:59:06.995159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 669/1354] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:06 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:08.019377 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:08.020071 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:08.026394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:08.026884 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:08.027325 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:08.028050 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:08.028512 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:08.028943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:08.160346 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:08.168957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d4b6d3b8-a969-4241-bef1-1a7932e18bd3 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1575 microversion: 2.1 time: 0.153811 Sep 15 00:59:08.170034 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 686/1355] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:08 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:08.992813 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-1ec395d4-81bc-49e8-bf7f-8c07ee016efb req-9f68f6da-f9ee-405e-825d-25b7b65bb67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c770ee1-1cc8-4af3-bb2c-ab3753156e37", "name": "network-vif-deleted", "tag": "d1b21f4d-7863-4a9c-ac7d-ae028778c2c8"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:09.002646 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-1ec395d4-81bc-49e8-bf7f-8c07ee016efb req-9f68f6da-f9ee-405e-825d-25b7b65bb67b service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.003122 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-1ec395d4-81bc-49e8-bf7f-8c07ee016efb req-9f68f6da-f9ee-405e-825d-25b7b65bb67b service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.003578 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-1ec395d4-81bc-49e8-bf7f-8c07ee016efb req-9f68f6da-f9ee-405e-825d-25b7b65bb67b service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.015542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-1ec395d4-81bc-49e8-bf7f-8c07ee016efb req-9f68f6da-f9ee-405e-825d-25b7b65bb67b service nova] Creating event network-vif-deleted:d1b21f4d-7863-4a9c-ac7d-ae028778c2c8 for instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 on hv-cinder-85752 Sep 15 00:59:09.020258 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-1ec395d4-81bc-49e8-bf7f-8c07ee016efb req-9f68f6da-f9ee-405e-825d-25b7b65bb67b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031601 Sep 15 00:59:09.020850 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 670/1356] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:59:09.193286 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:09.193841 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:09.200956 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.201481 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.201881 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.202578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.203042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.203473 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.268195 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd308262224af475091e6aa494ea839b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d8d76185c44a159439c0f7a0e88b31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:09.277627 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-9bbdd892-ea38-41b2-bd76-ebc173984c35 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 200 len: 1225 microversion: 2.1 time: 0.088234 Sep 15 00:59:09.278649 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 687/1357] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:09 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:09.384518 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "836c8f8f-f8cf-4eaa-8738-2f2439abd290"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:09.387022 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:09.393431 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.394166 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.394606 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.395319 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.395807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.396439 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.484653 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Invalid volume: volume 836c8f8f-f8cf-4eaa-8738-2f2439abd290 is already attached to instances: 8d91d915-a936-4f20-b538-f3b050a2e61d Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: POST /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments HTTP/1.1 Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 74 Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:59:09.486393 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {"volumeAttachment": {"volumeId": "836c8f8f-f8cf-4eaa-8738-2f2439abd290"}} Sep 15 00:59:09.488204 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Invalid volume: volume 836c8f8f-f8cf-4eaa-8738-2f2439abd290 is already attached to instances: 8d91d915-a936-4f20-b538-f3b050a2e61d Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'server_id': '8d91d915-a936-4f20-b538-f3b050a2e61d', 'body': {'volumeAttachment': {'volumeId': '836c8f8f-f8cf-4eaa-8738-2f2439abd290'}}} Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 836c8f8f-f8cf-4eaa-8738-2f2439abd290 is already attached to instances: 8d91d915-a936-4f20-b538-f3b050a2e61d Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:09.489158 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 836c8f8f-f8cf-4eaa-8738-2f2439abd290 is already attached to instances: 8d91d915-a936-4f20-b538-f3b050a2e61d Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:09.490673 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:09.492901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:09.492901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:59:09.492901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:59:09.492901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 836c8f8f-f8cf-4eaa-8738-2f2439abd290 is already attached to instances: 8d91d915-a936-4f20-b538-f3b050a2e61d Sep 15 00:59:09.492901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:09.492901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 400 to user: Invalid volume: volume 836c8f8f-f8cf-4eaa-8738-2f2439abd290 is already attached to instances: 8d91d915-a936-4f20-b538-f3b050a2e61d {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:59:09.492901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-596b69c9-2f30-4ea3-8253-7fbc9a774503 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108583 Sep 15 00:59:09.492901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 671/1358] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 00:59:09 2022] POST /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 00:59:09.554471 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:09.554978 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:09.560905 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.561394 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.561836 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.562540 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.563004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.563437 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.642993 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lazy-loading 'services' on Instance uuid 8d91d915-a936-4f20-b538-f3b050a2e61d {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:59:09.714943 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f976c299-6608-47e2-874f-3fef7911222f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments/836c8f8f-f8cf-4eaa-8738-2f2439abd290" status: 202 len: 0 microversion: 2.1 time: 0.164839 Sep 15 00:59:09.718591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 688/1359] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 00:59:09 2022] DELETE /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments/836c8f8f-f8cf-4eaa-8738-2f2439abd290 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 00:59:09.723842 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:09.726635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:09.732738 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.733270 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.733711 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.734420 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:09.734932 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:09.735364 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:09.770263 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-671478fe-bcae-467b-a73c-1533758f1b92 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050363 Sep 15 00:59:09.770835 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 672/1360] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:59:09 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:59:10.305135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:10.305843 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 4c770ee1-1cc8-4af3-bb2c-ab3753156e37] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:10.311972 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.312461 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.312903 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.313601 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.314059 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.314486 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.327861 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] HTTP exception thrown: Instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 could not be found. Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Request method failure captured: Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 HTTP/1.1 Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjInaDE_ROE34nHoRQmFXLIGCxGhmBDzx5igFLmHnB1uUoKzc_sN65y5Txyztrv7sCTkysb0cj3NzFWv7x6MgNnOVMPdnFAjOwhu7CYUbSNr-_h-eG1lQHZgPYTJwtBKAlUN9QxLKYIjVuHoQVddGJYUiGTKEcOvpI6h2kqlFs_HNpP8g Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 00:59:10.329460 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_53d8d76185c44a159439c0f7a0e88b31", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/53d8d76185c44a159439c0f7a0e88b31"}]}] Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: d308262224af475091e6aa494ea839b1 Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 could not be found. Sep 15 00:59:10.330911 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '4c770ee1-1cc8-4af3-bb2c-ab3753156e37'} Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 could not be found. Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:59:10.331815 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 could not be found. Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 could not be found. Sep 15 00:59:10.333427 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.335618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Returning 404 to user: Instance 4c770ee1-1cc8-4af3-bb2c-ab3753156e37 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:59:10.335618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-d684ca0c-c805-46f5-92fd-9ca8a2fc3d4d tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37" status: 404 len: 111 microversion: 2.1 time: 0.030424 Sep 15 00:59:10.335618 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 689/1361] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:10 2022] GET /compute/v2.1/servers/4c770ee1-1cc8-4af3-bb2c-ab3753156e37 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:59:10.770426 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:10.770941 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:10.777293 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.777778 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.778217 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.778905 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.779363 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.779819 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.783305 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:10.785558 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:10.791508 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.792007 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.792440 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.792887 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] HTTP exception thrown: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.793138 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.793586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.794007 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Request method failure captured: Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: DELETE /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 HTTP/1.1 Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInaDE_ROE34nHoRQmFXLIGCxGhmBDzx5igFLmHnB1uUoKzc_sN65y5Txyztrv7sCTkysb0cj3NzFWv7x6MgNnOVMPdnFAjOwhu7CYUbSNr-_h-eG1lQHZgPYTJwtBKAlUN9QxLKYIjVuHoQVddGJYUiGTKEcOvpI6h2kqlFs_HNpP8g Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:59:10.794435 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_53d8d76185c44a159439c0f7a0e88b31", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/53d8d76185c44a159439c0f7a0e88b31"}]}] Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: d308262224af475091e6aa494ea839b1 Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.796121 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '42c86872-2309-4e4c-88ad-e5b9c7166dd3'} Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:59:10.796991 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.798479 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.800078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Returning 404 to user: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:59:10.800078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-827ccfda-d6e1-4b3b-89d3-3562b48e6ed9 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "DELETE /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 404 len: 111 microversion: 2.1 time: 0.029278 Sep 15 00:59:10.800078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 673/1362] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:59:10 2022] DELETE /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:59:10.804761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:10.805369 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] [instance: 42c86872-2309-4e4c-88ad-e5b9c7166dd3] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:10.811046 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.811571 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.812009 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.812699 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.813153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.813575 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.826384 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-676544dd-b84f-4920-a936-7cc93a15f360 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046892 Sep 15 00:59:10.826939 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 690/1363] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 00:59:10 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 00:59:10.828260 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] HTTP exception thrown: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Request method failure captured: Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 HTTP/1.1 Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjInaDE_ROE34nHoRQmFXLIGCxGhmBDzx5igFLmHnB1uUoKzc_sN65y5Txyztrv7sCTkysb0cj3NzFWv7x6MgNnOVMPdnFAjOwhu7CYUbSNr-_h-eG1lQHZgPYTJwtBKAlUN9QxLKYIjVuHoQVddGJYUiGTKEcOvpI6h2kqlFs_HNpP8g Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:59:10.829807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_53d8d76185c44a159439c0f7a0e88b31", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53d8d76185c44a159439c0f7a0e88b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/53d8d76185c44a159439c0f7a0e88b31"}]}] Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 53d8d76185c44a159439c0f7a0e88b31 Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-TestVolumeBootPattern-168526169 Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: d308262224af475091e6aa494ea839b1 Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-TestVolumeBootPattern-168526169-project Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.831563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '42c86872-2309-4e4c-88ad-e5b9c7166dd3'} Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:59:10.832517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. Sep 15 00:59:10.834090 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:10.836058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Returning 404 to user: Instance 42c86872-2309-4e4c-88ad-e5b9c7166dd3 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:59:10.836058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-fdc0e7d5-d183-46c7-8195-152783a5d5b8 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3" status: 404 len: 111 microversion: 2.1 time: 0.030518 Sep 15 00:59:10.836058 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 674/1364] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:10 2022] GET /compute/v2.1/servers/42c86872-2309-4e4c-88ad-e5b9c7166dd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:59:10.895217 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:10.896251 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:10.902214 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.902694 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.903125 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.903857 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:10.904357 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:10.904777 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:10.930308 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Going to try to terminate instance {{(pid=127199) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 00:59:11.004479 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-aa8cc5e1-48bb-469b-ad86-cd23b7503a7a tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 204 len: 0 microversion: 2.1 time: 0.112793 Sep 15 00:59:11.005326 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 691/1365] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 00:59:10 2022] DELETE /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 00:59:11.013704 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:11.014321 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:11.020277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:11.020760 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:11.021198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:11.021888 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:11.022379 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:11.022807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:11.151021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:11.158761 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-56f3758a-21fd-4bb7-b688-b9303e5fc520 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1681 microversion: 2.1 time: 0.148997 Sep 15 00:59:11.159324 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 675/1366] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:11 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:12.138304 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b18b4ce8-4eb8-4731-bc44-94be9c9a7002 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] Calling method '.version_select at 0x7f2f20768f70>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:12.162298 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b18b4ce8-4eb8-4731-bc44-94be9c9a7002 tempest-TestVolumeBootPattern-168526169 tempest-TestVolumeBootPattern-168526169-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-309604362" status: 202 len: 0 microversion: 2.1 time: 0.028132 Sep 15 00:59:12.163090 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 692/1367] 10.222.0.15 () {58 vars in 1260 bytes} [Thu Sep 15 00:59:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-309604362 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:59:12.184708 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:12.185875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:12.192654 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:12.193144 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:12.193584 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:12.194966 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:12.195440 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:12.195888 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:12.333699 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:12.342342 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-6ebf3f96-d1cf-4b87-a9c4-529a3499e723 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1681 microversion: 2.1 time: 0.161452 Sep 15 00:59:12.342917 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 676/1368] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:12 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:13.366528 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:13.367279 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:13.375048 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:13.375582 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:13.376068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:13.376990 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:13.377455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:13.378110 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:13.723321 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:13.731767 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-8034ba36-0824-403b-9770-4019b304000b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1681 microversion: 2.1 time: 0.369729 Sep 15 00:59:13.732535 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 693/1369] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:13 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1681 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:14.658103 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-87e2269d-fdcb-4320-b0d6-da82cb44c04c req-adb41d75-78d6-4438-9810-69d743853970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d91d915-a936-4f20-b538-f3b050a2e61d", "name": "network-vif-deleted", "tag": "e800a621-1394-4d38-a779-6ed9ffbdca43"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:14.669273 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-87e2269d-fdcb-4320-b0d6-da82cb44c04c req-adb41d75-78d6-4438-9810-69d743853970 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:14.670148 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-87e2269d-fdcb-4320-b0d6-da82cb44c04c req-adb41d75-78d6-4438-9810-69d743853970 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:14.670803 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-87e2269d-fdcb-4320-b0d6-da82cb44c04c req-adb41d75-78d6-4438-9810-69d743853970 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:14.685065 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-87e2269d-fdcb-4320-b0d6-da82cb44c04c req-adb41d75-78d6-4438-9810-69d743853970 service nova] Creating event network-vif-deleted:e800a621-1394-4d38-a779-6ed9ffbdca43 for instance 8d91d915-a936-4f20-b538-f3b050a2e61d on hv-cinder-85752 Sep 15 00:59:14.691071 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-87e2269d-fdcb-4320-b0d6-da82cb44c04c req-adb41d75-78d6-4438-9810-69d743853970 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036504 Sep 15 00:59:14.696647 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 677/1370] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:59:14.754591 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:14.756445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:14.767194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:14.769230 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:14.773439 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:14.774449 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:14.775578 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:14.776237 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:14.791854 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:14.855419 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:14.855953 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:14.856398 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:14.856862 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lazy-loading 'fault' on Instance uuid 8d91d915-a936-4f20-b538-f3b050a2e61d {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 00:59:14.936793 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:14.953244 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7f1a94f4-3913-4fc6-a75c-3bf90d9a4e3f tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 200 len: 1332 microversion: 2.1 time: 0.202681 Sep 15 00:59:14.953826 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 694/1371] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:14 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 1332 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:15.979812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:15.981028 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:15.989277 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:15.989996 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:15.990620 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:15.991892 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:15.992509 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:15.993205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:16.012095 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d HTTP/1.1 Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 00:59:16.014398 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 00:59:16.016153 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '8d91d915-a936-4f20-b538-f3b050a2e61d'} Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 00:59:16.017124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 00:59:16.018800 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 00:59:16.021068 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 00:59:16.021930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-161720b2-080c-4b2d-83ce-877d89e1ff5c tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 404 len: 111 microversion: 2.1 time: 0.048855 Sep 15 00:59:16.024503 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 678/1372] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:15 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 00:59:16.033314 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-43bb4024-763f-4a35-9576-064ffcc036e1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '.version_select at 0x7f2f1cfabdc0>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:16.054132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-43bb4024-763f-4a35-9576-064ffcc036e1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680558882" status: 202 len: 0 microversion: 2.1 time: 0.024479 Sep 15 00:59:16.054816 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 695/1373] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 15 00:59:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680558882 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 00:59:16.825193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-0dc6e9b6-f2a8-403f-97e6-1b037aad8da9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: .version_select at 0x7f2f2077c160>, body: {"keypair": {"name": "tempest-keypair-551040579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG4EufGQV5p1QDPiXzMDc60Q0fcvGJ0wEF1rlJuvV1hs0JpfKqbC3KeWSup2SqC8kYMcR35IsmQxPkJxsISEsAScKkXrPa4vVgPFP/Iq4i9BGT7AsopVcjZ8aX8V0/9ag=="}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:16.842957 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-0dc6e9b6-f2a8-403f-97e6-1b037aad8da9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:59:16.847391 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.quota [None req-0dc6e9b6-f2a8-403f-97e6-1b037aad8da9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for user 778fc9ee164e46a9b874dd0e20d38392 and project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'key_pairs'} {{(pid=127200) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:59:16.871969 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-0dc6e9b6-f2a8-403f-97e6-1b037aad8da9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051280 Sep 15 00:59:16.872569 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 679/1374] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 15 00:59:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:59:18.174456 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1174066786", "imageRef": "716e0422-8ecd-413a-8fc1-729a561dd7d1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48f46f03-9920-4d15-b1d4-ea751486aaae"}], "security_groups": [{"name": "tempest-securitygroup--1477539943"}], "key_name": "tempest-keypair-551040579", "user_data": "}} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:18.287780 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.network.neutron [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] validate_networks() for [('48f46f03-9920-4d15-b1d4-ea751486aaae', None, None, None, None, None)] {{(pid=127199) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 00:59:18.697845 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Flavor limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 00:59:18.698278 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Image limits 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 00:59:18.698749 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Flavor pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 00:59:18.700568 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Image pref 0:0:0 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 00:59:18.700999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.virt.hardware [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 00:59:18.712685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:18.713538 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:18.714147 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:18.715127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:18.715635 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:18.716068 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:18.734124 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 00:59:18.738064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.quota [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Getting quotas for user 778fc9ee164e46a9b874dd0e20d38392 and project 3ef4db17e5d245cb9caab70d557f41ae. Resources: {'instances', 'ram', 'cores'} {{(pid=127199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 00:59:18.749541 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Going to run 1 instances... {{(pid=127199) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 00:59:18.751802 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='716e0422-8ecd-413a-8fc1-729a561dd7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 00:59:18.800652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-e1563a99-9759-4f44-8df9-69188fac4cd1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630543 Sep 15 00:59:18.801605 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 696/1375] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 15 00:59:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 00:59:18.813672 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-98b06b99-1070-4f2f-919a-597400c7556b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:18.815198 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-98b06b99-1070-4f2f-919a-597400c7556b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:18.909231 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-98b06b99-1070-4f2f-919a-597400c7556b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:18.918362 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-98b06b99-1070-4f2f-919a-597400c7556b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1241 microversion: 2.1 time: 0.109021 Sep 15 00:59:18.919955 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 680/1376] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:18 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 00:59:19.943656 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:19.944484 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:19.950937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:19.951776 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:19.952488 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:19.953456 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:19.953979 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:19.954629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:20.078677 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:20.087788 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-54afd719-ac9c-4c80-b9f5-532514e17fd5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1301 microversion: 2.1 time: 0.149836 Sep 15 00:59:20.088376 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 697/1377] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:19 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1301 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:21.112788 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:21.113392 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:21.120264 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:21.121056 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:21.121663 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:21.122559 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:21.123181 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:21.123839 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:21.277021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:21.284834 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4b313fb3-b5f7-4df9-b1bc-31abb24bade5 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1367 microversion: 2.1 time: 0.176148 Sep 15 00:59:21.285402 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 681/1378] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:21 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:21.838862 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-f6c08be4-a322-4458-b937-027b77938408 req-02e868f3-7268-4b32-be7b-2be527128a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec18fc1b-3148-4360-b7e2-d8caf446ce47", "tag": "e69990d7-d5a9-4ee1-b164-cfbb26f3bc24"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:21.851224 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f6c08be4-a322-4458-b937-027b77938408 req-02e868f3-7268-4b32-be7b-2be527128a4b service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:21.851897 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f6c08be4-a322-4458-b937-027b77938408 req-02e868f3-7268-4b32-be7b-2be527128a4b service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:21.852334 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-f6c08be4-a322-4458-b937-027b77938408 req-02e868f3-7268-4b32-be7b-2be527128a4b service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:21.863183 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-f6c08be4-a322-4458-b937-027b77938408 req-02e868f3-7268-4b32-be7b-2be527128a4b service nova] Creating event network-changed:e69990d7-d5a9-4ee1-b164-cfbb26f3bc24 for instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 on hv-cinder-85752 Sep 15 00:59:21.868078 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-f6c08be4-a322-4458-b937-027b77938408 req-02e868f3-7268-4b32-be7b-2be527128a4b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033408 Sep 15 00:59:21.868676 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 698/1379] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:59:22.308386 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:22.309005 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:22.315697 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:22.316193 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:22.316633 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:22.317355 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:22.317842 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:22.318268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:22.442791 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:22.451041 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a39db62d-9ae2-46f9-9b2b-24548aa3688e tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1367 microversion: 2.1 time: 0.146415 Sep 15 00:59:22.451782 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 682/1380] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:22 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:23.474565 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:23.475302 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:23.481463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:23.481951 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:23.482392 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:23.483088 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:23.483586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:23.484024 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:23.611856 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:23.619988 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7b7b413d-16e0-4dd2-a7d3-b4212de44233 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1367 microversion: 2.1 time: 0.150130 Sep 15 00:59:23.620549 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 699/1381] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:23 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:24.642135 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:24.642751 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:24.649149 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:24.649634 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:24.650071 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:24.650824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:24.651227 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:24.651701 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:24.776202 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:24.783606 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-63a7e934-7fd6-4a20-8710-4f34d5a37383 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1367 microversion: 2.1 time: 0.145340 Sep 15 00:59:24.784164 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 683/1382] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:24 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:25.807028 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:25.807705 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:25.814136 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:25.814621 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:25.815064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:25.815794 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:25.816254 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:25.816685 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:25.943812 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:25.951339 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-c7acb3f8-d160-41af-b594-8eb49d3289b1 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1367 microversion: 2.1 time: 0.148694 Sep 15 00:59:25.951930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 700/1383] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:25 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:26.973938 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:26.974677 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:26.981404 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:26.981957 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:26.982614 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:26.983545 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:26.984177 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:26.984612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:26.985924 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [req-6b7c9f5a-7ad0-4da5-859e-91e01691a82b req-166c476a-aece-438e-b97b-16725177c502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec18fc1b-3148-4360-b7e2-d8caf446ce47", "name": "network-vif-plugged", "status": "completed", "tag": "e69990d7-d5a9-4ee1-b164-cfbb26f3bc24"}]} {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:26.996625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6b7c9f5a-7ad0-4da5-859e-91e01691a82b req-166c476a-aece-438e-b97b-16725177c502 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:26.997522 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6b7c9f5a-7ad0-4da5-859e-91e01691a82b req-166c476a-aece-438e-b97b-16725177c502 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:26.998175 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [req-6b7c9f5a-7ad0-4da5-859e-91e01691a82b req-166c476a-aece-438e-b97b-16725177c502 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:27.004199 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:27.010937 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.compute.server_external_events [req-6b7c9f5a-7ad0-4da5-859e-91e01691a82b req-166c476a-aece-438e-b97b-16725177c502 service nova] Creating event network-vif-plugged:e69990d7-d5a9-4ee1-b164-cfbb26f3bc24 for instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 on hv-cinder-85752 Sep 15 00:59:27.016104 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [req-6b7c9f5a-7ad0-4da5-859e-91e01691a82b req-166c476a-aece-438e-b97b-16725177c502 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Sep 15 00:59:27.017213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 701/1384] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 00:59:27.123786 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:27.132242 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-8e4aad84-396e-4427-bb19-9d11b3db7fad tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1367 microversion: 2.1 time: 0.161530 Sep 15 00:59:27.132815 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 684/1385] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:26 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:28.156342 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:28.157089 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:28.163293 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:28.163818 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:28.164259 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:28.164957 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:28.165414 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:28.165846 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:28.292114 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:28.299652 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-44084222-5461-450e-9dc9-d9697d544747 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1367 microversion: 2.1 time: 0.148028 Sep 15 00:59:28.300212 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 702/1386] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:28 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:29.322239 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:29.322851 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:29.325254 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell0:SELECT=6 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:29.325897 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:29.331452 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:29.331967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:29.332401 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:29.333097 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:29.333542 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:29.333961 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:29.465284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 00:59:29.473078 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-f6117328-b8e0-4976-93c7-6ffa8a8df459 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1556 microversion: 2.1 time: 0.154692 Sep 15 00:59:29.473651 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 685/1387] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 00:59:29 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 00:59:29.495519 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 00:59:29.496029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 00:59:29.497938 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=2 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:29.498596 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell0:SELECT=6 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:29.499740 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:29.505714 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:29.506556 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:29.506999 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:29.507741 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:29.508200 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:29.508634 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:29.589109 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-a016da51-4d3c-4326-b2ca-7c3b882a5395 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097377 Sep 15 00:59:29.589734 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 703/1388] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 15 00:59:29 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 00:59:30.503875 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-e3ba4413-948f-4d1d-823c-a1a454ff9da3 req-1715689f-2ce3-4f5c-9172-963362fe33c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec18fc1b-3148-4360-b7e2-d8caf446ce47", "tag": "e69990d7-d5a9-4ee1-b164-cfbb26f3bc24"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 00:59:30.514557 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-e3ba4413-948f-4d1d-823c-a1a454ff9da3 req-1715689f-2ce3-4f5c-9172-963362fe33c9 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 00:59:30.515038 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-e3ba4413-948f-4d1d-823c-a1a454ff9da3 req-1715689f-2ce3-4f5c-9172-963362fe33c9 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 00:59:30.515469 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-e3ba4413-948f-4d1d-823c-a1a454ff9da3 req-1715689f-2ce3-4f5c-9172-963362fe33c9 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 00:59:30.526901 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-e3ba4413-948f-4d1d-823c-a1a454ff9da3 req-1715689f-2ce3-4f5c-9172-963362fe33c9 service nova] Creating event network-changed:e69990d7-d5a9-4ee1-b164-cfbb26f3bc24 for instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 on hv-cinder-85752 Sep 15 00:59:30.532392 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-e3ba4413-948f-4d1d-823c-a1a454ff9da3 req-1715689f-2ce3-4f5c-9172-963362fe33c9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032140 Sep 15 00:59:30.533128 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 686/1389] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 00:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 01:00:35.111070 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_cell1:SELECT=40 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 01:00:35.111839 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG dbcounter [-] [127199] Writing DB stats nova_api:SELECT=1 {{(pid=127199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 01:00:35.116063 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:35.116555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:35.123761 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:35.124245 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:35.124682 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:35.125372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:35.125823 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:35.126246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:35.148828 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-67c3a044-7da8-4cbc-881d-50874f9394f3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/ips" status: 200 len: 149 microversion: 2.1 time: 0.039668 Sep 15 01:00:35.149920 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 704/1390] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 15 01:00:35 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 01:00:36.477350 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_api:SELECT=3 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 01:00:36.478100 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG dbcounter [-] [127200] Writing DB stats nova_cell1:SELECT=10 {{(pid=127200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 01:00:36.483405 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15854aaa-0166-481f-aef7-88430174a93c"}} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 01:00:36.485849 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:36.492782 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:36.493273 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:36.493715 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:36.494417 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:36.494877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:36.495311 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:36.959197 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-92e5d263-ce72-4f1d-a23c-1ac7b086cae9 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "POST /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483207 Sep 15 01:00:36.960325 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 687/1391] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 15 01:00:36 2022] POST /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 01:00:44.774361 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:44.774913 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:44.782004 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:44.782489 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:44.782930 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:44.783674 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:44.784132 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:44.784561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:44.917127 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.objects.instance [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lazy-loading 'services' on Instance uuid ec18fc1b-3148-4360-b7e2-d8caf446ce47 {{(pid=127199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 01:00:44.987667 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-bcf5cfd1-11e1-414d-ae98-2d1c4de1e435 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-volume_attachments/15854aaa-0166-481f-aef7-88430174a93c" status: 202 len: 0 microversion: 2.1 time: 0.217305 Sep 15 01:00:44.988246 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 705/1392] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 15 01:00:44 2022] DELETE /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-volume_attachments/15854aaa-0166-481f-aef7-88430174a93c => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 01:00:44.997563 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:44.999967 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:45.008037 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:45.008525 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:45.008962 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:45.009748 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:45.010906 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:45.011339 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:45.040830 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d5b981fe-1caf-4e24-8c0c-34dd6c73f486 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047943 Sep 15 01:00:45.041416 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 688/1393] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 01:00:44 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 01:00:46.055060 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:46.057403 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:46.063625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:46.064117 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:46.064553 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:46.065250 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:46.065703 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:46.066130 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:46.097642 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-17494b91-ecc2-4d06-a379-1117c711b055 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047650 Sep 15 01:00:46.098197 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 706/1394] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 15 01:00:46 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 01:00:46.162954 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:46.163350 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:46.170443 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:46.170930 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:46.171377 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:46.172124 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:46.172581 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:46.173010 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:46.201389 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Going to try to terminate instance {{(pid=127200) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 01:00:46.278719 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-efffa7c9-950d-4b19-8264-7c4ba39fbee4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 204 len: 0 microversion: 2.1 time: 0.119399 Sep 15 01:00:46.279548 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 689/1395] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 01:00:46 2022] DELETE /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 01:00:46.287372 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:46.288037 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:46.294625 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:46.295115 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:46.295613 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:46.296350 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:46.296814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:46.297240 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:46.426229 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 01:00:46.433955 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-f82df52b-ac8c-459e-b477-8e8ed4bb6820 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1681 microversion: 2.1 time: 0.150417 Sep 15 01:00:46.434517 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 707/1396] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 01:00:46 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 01:00:47.458285 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:47.459013 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:47.465609 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:47.466084 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:47.466517 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:47.467205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:47.467693 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:47.468114 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:47.598658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.policy [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127200) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 01:00:47.606812 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-4039107b-9277-49cb-bc90-20492dd23dae tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1681 microversion: 2.1 time: 0.152902 Sep 15 01:00:47.607370 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 690/1397] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 01:00:47 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 01:00:48.630206 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:48.630827 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:48.638213 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:48.638702 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:48.639143 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:48.639878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:48.640337 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:48.640764 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:48.847507 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.policy [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778fc9ee164e46a9b874dd0e20d38392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef4db17e5d245cb9caab70d557f41ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127199) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 01:00:48.855579 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6058c78a-e47f-420e-abec-8b0d1310fac4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 200 len: 1681 microversion: 2.1 time: 0.229190 Sep 15 01:00:48.856184 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 708/1398] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 01:00:48 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 01:00:49.293554 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [req-a46c6e0d-2547-44f7-80b9-5ee1397c10f3 req-3de7fa83-de46-497e-a207-6b893c458464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec18fc1b-3148-4360-b7e2-d8caf446ce47", "name": "network-vif-deleted", "tag": "e69990d7-d5a9-4ee1-b164-cfbb26f3bc24"}]} {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 01:00:49.303700 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a46c6e0d-2547-44f7-80b9-5ee1397c10f3 req-3de7fa83-de46-497e-a207-6b893c458464 service nova] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:49.304389 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a46c6e0d-2547-44f7-80b9-5ee1397c10f3 req-3de7fa83-de46-497e-a207-6b893c458464 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:49.305061 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [req-a46c6e0d-2547-44f7-80b9-5ee1397c10f3 req-3de7fa83-de46-497e-a207-6b893c458464 service nova] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:49.320268 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.compute.server_external_events [req-a46c6e0d-2547-44f7-80b9-5ee1397c10f3 req-3de7fa83-de46-497e-a207-6b893c458464 service nova] Creating event network-vif-deleted:e69990d7-d5a9-4ee1-b164-cfbb26f3bc24 for instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 on hv-cinder-85752 Sep 15 01:00:49.325921 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [req-a46c6e0d-2547-44f7-80b9-5ee1397c10f3 req-3de7fa83-de46-497e-a207-6b893c458464 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097311 Sep 15 01:00:49.326577 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 691/1399] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 15 01:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 01:00:49.880555 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:49.881187 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:49.887758 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:49.888252 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:49.888695 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:49.889438 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:49.889899 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:49.890332 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:49.904187 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 HTTP/1.1 Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 01:00:49.905878 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:49.907712 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'ec18fc1b-3148-4360-b7e2-d8caf446ce47'} Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:49.908650 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:49.910119 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:49.911383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:49.911383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-b380a54f-9dcd-4948-8c69-863510279832 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 404 len: 111 microversion: 2.1 time: 0.031509 Sep 15 01:00:49.911383 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 709/1400] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 01:00:49 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 01:00:49.916658 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-d75af5c5-a794-404f-9c8c-dc6408ec93a7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '.version_select at 0x7f2f207ac310>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:49.936488 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-d75af5c5-a794-404f-9c8c-dc6408ec93a7 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551040579" status: 202 len: 0 microversion: 2.1 time: 0.023754 Sep 15 01:00:49.936999 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 692/1401] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 15 01:00:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551040579 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 01:00:51.700587 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:51.701194 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:51.707447 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:51.708001 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:51.708445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:51.709148 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:51.709610 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:51.710044 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:51.723210 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 HTTP/1.1 Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 01:00:51.724814 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.726483 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': 'ec18fc1b-3148-4360-b7e2-d8caf446ce47'} Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:51.727463 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.729064 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.730630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:51.730630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7d679fca-16ad-4ae3-8b34-697234544e69 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 404 len: 111 microversion: 2.1 time: 0.030126 Sep 15 01:00:51.730630 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 710/1402] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 01:00:51 2022] DELETE /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 01:00:51.734636 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:51.735396 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: ec18fc1b-3148-4360-b7e2-d8caf446ce47] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:51.742538 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:51.743022 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:51.743456 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:51.744183 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:51.744637 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:51.745057 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:51.758635 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 HTTP/1.1 Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 01:00:51.760265 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.762535 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': 'ec18fc1b-3148-4360-b7e2-d8caf446ce47'} Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:51.763436 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. Sep 15 01:00:51.765063 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:51.766504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance ec18fc1b-3148-4360-b7e2-d8caf446ce47 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:51.766504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-3a406088-f64a-407b-918a-ce39753a5b65 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47" status: 404 len: 111 microversion: 2.1 time: 0.030914 Sep 15 01:00:51.766504 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 693/1403] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 01:00:51 2022] GET /compute/v2.1/servers/ec18fc1b-3148-4360-b7e2-d8caf446ce47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 01:00:52.899561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:52.900042 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:52.906977 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:52.907455 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:52.907919 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:52.908606 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:52.909057 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:52.909477 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:52.922445 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d HTTP/1.1 Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 01:00:52.923992 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.925690 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '8d91d915-a936-4f20-b538-f3b050a2e61d'} Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:52.926708 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.928418 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.930034 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:52.930034 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-6ce4ef11-f083-4a0b-8963-a9dc9faa8da3 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 404 len: 111 microversion: 2.1 time: 0.029616 Sep 15 01:00:52.930034 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 711/1404] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 01:00:52 2022] DELETE /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 01:00:52.933607 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:52.934221 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 8d91d915-a936-4f20-b538-f3b050a2e61d] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:52.941807 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:52.942297 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:52.942733 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:52.943433 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:52.943911 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:52.944333 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:52.959068 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d HTTP/1.1 Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 01:00:52.960662 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.962284 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '8d91d915-a936-4f20-b538-f3b050a2e61d'} Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:52.963140 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. Sep 15 01:00:52.965870 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:52.968513 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 8d91d915-a936-4f20-b538-f3b050a2e61d could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:52.968513 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-b07c5a60-4639-428b-af83-4d2e1a8263f4 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d" status: 404 len: 111 microversion: 2.1 time: 0.032355 Sep 15 01:00:52.968513 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 694/1405] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 01:00:52 2022] GET /compute/v2.1/servers/8d91d915-a936-4f20-b538-f3b050a2e61d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 01:00:52.971584 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:52.972476 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:52.980335 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:52.981007 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:52.981443 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:52.982135 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:52.982586 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:52.983011 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:52.997629 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f HTTP/1.1 Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 01:00:52.999226 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.001073 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '919d6f99-161e-4c7f-b7e8-2183095d5e1f'} Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:53.002029 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.003675 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.005270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:53.005270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-7cc67cda-8041-4ddf-8ba4-e5f1b9a87a73 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 404 len: 111 microversion: 2.1 time: 0.033118 Sep 15 01:00:53.005270 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 712/1406] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 01:00:52 2022] DELETE /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 01:00:53.009709 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:53.010973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 919d6f99-161e-4c7f-b7e8-2183095d5e1f] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:53.017491 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:53.017982 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:53.018427 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:53.019127 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:53.019659 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:53.020092 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:53.033688 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f HTTP/1.1 Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 01:00:53.035205 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.036925 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '919d6f99-161e-4c7f-b7e8-2183095d5e1f'} Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:53.037877 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. Sep 15 01:00:53.039455 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:53.041159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 919d6f99-161e-4c7f-b7e8-2183095d5e1f could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:53.041159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-a485bf0d-04a3-4d50-b5b1-b114501dfa80 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f" status: 404 len: 111 microversion: 2.1 time: 0.031025 Sep 15 01:00:53.041159 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 695/1407] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 01:00:53 2022] GET /compute/v2.1/servers/919d6f99-161e-4c7f-b7e8-2183095d5e1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 01:00:54.175952 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:54.176566 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.compute.api [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127199) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:54.182980 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:54.183722 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:54.184176 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:54.184872 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:54.185328 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:54.185757 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG oslo_concurrency.lockutils [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:54.198784 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.wsgi [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: request: DELETE /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 HTTP/1.1 Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept: application/json Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Accept-Encoding: identity Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Connection: close Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Length: 0 Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Content-Type: application/json Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Host: 10.222.0.15 Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: Openstack-System-Scope: None Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Id: None Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Domain-Name: None Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Identity-Status: Confirmed Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Is-Admin-Project: True Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Id: default Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Domain-Name: Default Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Role: member,reader Sep 15 01:00:54.200902 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Roles: member,reader Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Id: default Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Domain-Name: Default Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: method: > Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: exception: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.202571 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: action_args: {'id': '6e47eda5-dffe-41dd-a09d-0870d19dd898'} Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: {{(pid=127199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:54.203561 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.205235 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.206790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: DEBUG nova.api.openstack.wsgi [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. {{(pid=127199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:54.206790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: INFO nova.api.openstack.requestlog [None req-267c5d90-3900-43f6-90da-512bd4d4ca86 tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 404 len: 111 microversion: 2.1 time: 0.030115 Sep 15 01:00:54.206790 dv-cinder-857528-2-iscsi devstack@n-api.service[127199]: [pid: 127199|app: 0|req: 713/1408] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 15 01:00:54 2022] DELETE /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 01:00:54.210824 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Calling method '>' {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 01:00:54.211444 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.compute.api [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] [instance: 6e47eda5-dffe-41dd-a09d-0870d19dd898] Fetching instance by UUID {{(pid=127200) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 01:00:54.218486 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:54.218973 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:54.219411 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:54.220211 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Acquiring lock "aaf2701d-e0f5-4078-a270-45cab29cee46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 01:00:54.220593 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 01:00:54.221021 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG oslo_concurrency.lockutils [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Lock "aaf2701d-e0f5-4078-a270-45cab29cee46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 01:00:54.234612 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.wsgi [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] HTTP exception thrown: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Request method failure captured: Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: request: GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 HTTP/1.1 Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept: application/json Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Accept-Encoding: identity Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Connection: close Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Length: 0 Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Content-Type: application/json Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Host: 10.222.0.15 Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: Openstack-System-Scope: None Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: User-Agent: python-urllib3/1.26.12 Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Auth-Token: gAAAAABjIndx8YperrtEM1SjWrRD5_tvs-F0jZSdmUNZKAiXQrs92OS1GOCNr_QGqoQlvhuk0xHJ3ilZZoSagLjn02XQqEfgneWnSOx4uDUoH9diiKSbBaKrmxJ41v3L3zyGm1WgfQwn5ywvQtd2arr9iKRvgRmppOlsUvTLgjATR6QikPzJnYQ Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Id: None Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Domain-Name: None Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Identity-Status: Confirmed Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Is-Admin-Project: True Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Id: default Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Domain-Name: Default Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Project-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Role: member,reader Sep 15 01:00:54.236171 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Roles: member,reader Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ef4db17e5d245cb9caab70d557f41ae", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ef4db17e5d245cb9caab70d557f41ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ef4db17e5d245cb9caab70d557f41ae"}]}] Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Id: 3ef4db17e5d245cb9caab70d557f41ae Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1121993310 Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Id: default Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Domain-Name: Default Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Id: 778fc9ee164e46a9b874dd0e20d38392 Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: X-User-Name: tempest-AttachVolumeNegativeTest-1121993310-project Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: method: > Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: exception: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.237696 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: action_args: {'id': '6e47eda5-dffe-41dd-a09d-0870d19dd898'} Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: {{(pid=127200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 01:00:54.238639 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. Sep 15 01:00:54.240384 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: ERROR nova.api.openstack.wsgi Sep 15 01:00:54.241794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: DEBUG nova.api.openstack.wsgi [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] Returning 404 to user: Instance 6e47eda5-dffe-41dd-a09d-0870d19dd898 could not be found. {{(pid=127200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 01:00:54.241794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: INFO nova.api.openstack.requestlog [None req-16904512-2f11-4a72-b56d-ae357eccd05b tempest-AttachVolumeNegativeTest-1121993310 tempest-AttachVolumeNegativeTest-1121993310-project] 10.222.0.15 "GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898" status: 404 len: 111 microversion: 2.1 time: 0.030562 Sep 15 01:00:54.241794 dv-cinder-857528-2-iscsi devstack@n-api.service[127200]: [pid: 127200|app: 0|req: 696/1409] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 15 01:00:54 2022] GET /compute/v2.1/servers/6e47eda5-dffe-41dd-a09d-0870d19dd898 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)